James dropped from the tree he was in because another villager(npc) started their shift, so he went to the temple, because he saw a few others headed that way earlier.