For a religious order that teaches peace, they are remarkably violent. They probably got caught up in the loop long ago, when people realized that they could always ask people with super powers for help if they wanted to. It's the thing that happens with superheros and villains in the comics, or with police and criminals in real life.

If we are with the KOTOR timeline, then the events will go like:
1) We hear that Bastilla has been sent on a special mission with the fleet. We are still on Coruscant or Dantooine being trained, some as initiates (if anyone wants to just be starting off) and some as Padawans. I know they said "we wouldn't normally accept an adult for training", but we can come up with reasons for us to be accepted, either because we aren't adults yet, or because there is some sort of extenuating circumstances (we were rescued from the Sith who kidnapped us to train us, but didn't get far in the training before we were rescued or something.)
2) A few days later we here that her ship was destroyed. We want to rescue her, but in order to keep us from doing that the Jedi send us all on another mission.