Now that you mention it, I think it would be cool if the bandits were a part of the conspiracy by the Sect. That way they would play more of a role in the grand scheme of things. 

Also I edited my post. I put the character's name at the top and his location and put his name as the first word in the actual post. Sorry about that, he, thing, I wasn't trying for being anonymous.