Mm, true enough, and there's often also prejudice against quirks that do "freaky" things (like Himiko's and Shinso's). And quirkless people are probably the worst off.