I just realised a minor detail that's wrong in mine ... Only saw it after looking at some of the wiki pages.
To get Anneal blade, the quest is at the town we are currently headed to, lol. I can change it that my character has already gone to that town, which is why he has the Anneal blade.
Infact, assume that's what happened, and I just had it wrong before.