I kinda like the idea, however how about the entire town is stuck in that dimension where all the reincarnations gather? And there is like a secondary realm where some are summoned to fight for the amusement of the time witch?

I feel like it gets rid of reincarnation idea so I tried to tweak it a bit What do the others think?