Well, uh...

To move Kekkai Sensen along, I need Saber, at the very minimum, to move. Dunno if Jack will, but Saber's the very least.
If Rin decides to pop in again, I'll just handwave and say that Jack was with them the whole time.