They maybe look down on humans, but Empire is still their greatest allie. They work with empire more then elves do. There are dwarfs who oversee mining operations, some teach in Nuln academy and so on. They might be pretty rare, but they are still much more casual sight than elf is.