If the "normals" had a problem with the orphanage they would have tried to get rid of it a long time ago or kept it from being opened in the first place, legally. Just because the majority of people there had super shitty parents doesn't mean the general populous go out of their way to be obscene dickheads.