You might want to come up with some esoteric semi-logical reason why he can't far-travel Gilgex. Finding the rest of the player characters again might be difficult.