Yea, people pretty much know each other. The population of 500 includes the children and the elderly. And even if a character is intentionally isolated, there are so few of those people that they would be known for being isolated, like the "weirdo brewers" we have in the works.