Anti-paladins exist for when characters considered to be the most LN fall. It happens, and I think it was 10mil but it could have been like 10-100k. For now we are good-neutral but times can get lean and things can happen. The picture was meant as a joke but it does bear significant truth, a minor shift in targets is all it would take to turn us from adventurer's to raider and we would not even realize it had happened until we are shown by another.

Edit: I remembered incorrectly. It was indeed 10k and Ollum was correct.