That's why I stated "between" worlds. He isn't in an actually place. He is between worlds. Which I figured was how some would have to travel. For example, Asgard is technicall y a different world. One would have to travel between them to reach them.