He simply rubs Austin the wrong way time and time again, and has never done anything to make him feel like he deserves Austin's liking of him. And he doesn't like it when people thing that they are above everyone else, even if they actually are he doesn't feel like it is the right thing to do. Which is one reason as to why he likes Connor so much.