I don't even remember what he told Naruto from the start. Something about us being different from birth and that there's no way someone can break out of their bonds, right?
He was sort of doing the whole Vegeta-Schick, but in reverse. Right? I always wished he would've fought Lee and told him that, and not Naruto. That would've been more fitting.

Regardless, in the Naruto world, he is mostly right, in the real world, not so much. Someone who's born special will always stay special. Naruto and Sasuke had their destiny laid out for them from the start. Neji was right about Naruto, he couldn't change his destiny.