Well in most fantasy universes, there's a much smaller population per race, and the race tends to be far more unified than our world is. So usually that means a common language.