Hm... I mean, the most simple solution I can think of is having the village he returns to being another one. Otherwise, I'm not certain. Maybe some sort of clue on my end could lead my guy in that direction?