He wondered about it until Olivia said there was no way a knight would want to be with a thief. She basically convinced him it can't happen :p