[@Abefroeman] Since the Boars were so far North, they would have been the first to have been hit by the Walkers. Returning all the way during the chaos would have been a foolhardy notion at best. It makes more sense for some of the Boars to have went south but returned out of a distrust for the "kneelers" or perhaps they joined up with other chieftains like the Weeper. 

I will also say that while not as bad as it used to be, there are still packs of Wights roaming BTW and other beasties are about now. And I was working on my own King Beyond the Wall type character who could be something of a rival to this clan. All in all, it's shaping up well though.