One in five of the total population...
Still a bit much. In 400 AD the largest city was Rome, with 800,000 people. But the Roman Empire had spanned most of Europe and the middle east. In 500 AD, the biggest city was Constantinople in Turkey at 450,000 people. If you are a major empire, like you are, something between these two numbers is most fitting.