The 4/10 is ALL magical races, not just magicians. The magicians are only about 1/2 of 1% of all the magical races. While the most prolific, they are not the only magical species. And since only a few magicians rally have any interest in interacting with humans, there are only a few in the human realm at any given moment. Make sense?