Think of him like a nightmare, the only time it has a power over you is when you fear it. Once you don't fear it you can move pass it to better dreams. 

Since I sound like a vague prick when I put it that way let me try it this way. Someone doesn't have a fear he can pull from he can't hurt that person, but since most people have some form of fear he rarely has that problem.

As for the teleporting think of it like Slender walking, no going across the country but able to get a few blocks away.