I'm pretty sure about 4.000 of them would follow him because of admiration/loyalty right about now. The rest would remain under control for fear of his abilities. Though fear and admiration are washed away with time unless cultivated.