He didnt see many people outside the shrine, only a younger couple. He figured if that the others were already inside. They probably had the same idea as him, searching for valuables. He moved around the shrine I the back, and snuck up to the building in such a way that he couldn't be seen.