Orcs, Goblins, and Trolls are fundamentally either "violent barbarians" or "dim-witted beasts" in this universe.

Naga and Harpies don't have such things associated with them, thus, are ok. Also, they're waifus, unlike the greenskins.