I don't know about the entirety of humanity having once been under a single empire, but some kingdoms having a religion in common would be nice. Things can feel haphazard when there's no real similarities, religious or cultural, between kingdoms.