We're an order of knights with a backup force. We don't need a huge army to take on bandits, even if they're pretty nasty bandits who've raided villages and stuff. It's quality over quantity.