What about Kyoto?

It's the best of both worlds; it's a major city in the Kansai region like Osaka, and also technically still the capital (though if I recall government administration takes place in Tokyo and the Imperial Residence is in Tokyo nowadays). Or you could go for something less central Japan and maybe Sendai or something.