I'm tying myself into knots trying to justify in-character how I don't end up Murder/Banishing the rest of the PCs. 

Aah, the joys of being the token Good character.