We can go with Cas getting shot in the leg. That would also make it more difficult for them to get back, because he wouldn't be able to move quickly.

And yeah, it just feels like it flows better if they overhear a conversation at or near the prison, rather than making an entire separate detour for that part. Cas would be inclined to make a beeline for the capital from there, since he'll realize what had happened.