No, they're too close to the bandit camp. They were on their way to attack already, Fanilly just made the plan of attack explicit and split everyone into four groups.