The dwar--guan (lol) came from the same star system as the laujin, explaining their similar humanoid looks. But had a significant technological advantage early on. (doubt warp drive as if that were true, they would be far more advanced than now.) many years.. Centuries.. ago when the vygran dominion was founded and began its initial aggressive expansion, your fairi-fay were close enough to the beginning assault that they did what they did. 

Vygrans would have lesser races integrated but none would be prolific enough to really matter (aside from fluff). Your ancient neighbor would have been a victim. It all just fits.

You have the potential of having your roots in the immediate area near the dominions home. Like alpha centari distance away. So yeah, we have some potential.