If I wasn't clear enough IC: Frore isn't on top of the windmill. He's sitting on the ground next to its base, which just so happens to be near a cliff facing the village.

...yes I did get all that from the picture of the Kakariko wiki.