I think the bandits are dead by now, if you're just entering town it's quite the blood bath with bodies on pretty much every street I believe. I know there's at least five bandits dead on the main street.