There's also the possibility someone else's society came across a surviving nation of the fallen empire and integrated it into their currently living empire.