I'm a bit behind, but I think raiders or a warband would be a proper first conflict. 
As far as getting the interest of the out of towners - I mean, common morals would tell us that these raiders are inherently bad, and this may be enough for the out of towners to defend the town