Depends on the route the quest itself takes. There could be a bigger threat than Ganondorf out there, he could be using the party to get to him, or hell, he could just like the party members enough that he'll put off his plans for an adventure. I plan to improvise it.