You can time skip yourself, when you want. The quest giver isn't going anywhere.