Then there wouldn't be the Supremes. The Supremes' existence proves that other galaxies exist. And with the rate of growth, a single galaxy wouldn't be enough, especially with everyone's reluctance to fight over resources.