The IC-justification I'd always go with is that people actively resist ESP because, at least on some level, they're aware of it. Makes it take work to use on random people, and just shrugged off by anyone potent enough to be a threat if you can fling things around at will. xD