I assumed the manor or palace or whatever they lived in would be just slightly removed from the town, and hopefully close enough for the vermin to infiltrate, but I might be wrong about that.