Well, it is a part of human nature to blame all for the actions of some. So, I'd say that at some point in the past the humans began blaming all none humans for the trouble caused by the evil and mischievous races, and feeling that was unfair the none humans fought back, making the humans feel all justified! Make sense?