Abigail could be kind of a rebound?  Or something like that?  Someone he goes through the motions of having a relationship with but without much emotional attachment.
I dunno though.  I like the idea of Abigail having that unjustified narcissism.  

It might.  But the odds are already low, are they not?  Especially with it looking like, on the surface, that Elizabeth and Rowland are a couple.  And I could see him kind of not meaning it but it coming out in a flurry of anger?  Look at all she's done to him.  She robbed him of his humanity against his will, burned his house down, then created the family he wanted with her without him.  If there was a confrontation, I could see him blurting that out.  Whether he means it, whether she completely believes him, that's up for debate, but it'd still sting.

I would hope he missed her touch.  That'll probably be a huge point of tension between them.  They'll be near each other, always craving each other's touch, but there'll always be some reason they won't.