Gasoline is to power prison vehicles and emergency generators. Guns are for situations exactly like the one we're in right now.

Obviously the prisoners wouldn't have ready access to them, but it's safe to assume they've busted into the fuel pumps and armory by brute force or careful planning.