That's not really suspicion then, that's common sense. Loyal to a fault would mean he'd stick around with a bad leader long after it would be in his best interests to leave.