Like, some kind of insane wizard or entity that keeps up the population of the old city by summoning people from other places? Or an item that, when activated, summons people? Either way, it's crazy enough to work!