He only uses it if threatened. That's why he got it, his mentor (Cas) taught him how to defend himself without it against nonpowered people.