I mean Rashomon summons gates, so I wouldn't say summoning inanimate objects is too far-fetched. IDK, maybe make it a group summoning of sorts like that three snakes summoned by multiple Oto and Suna ninjas during the chunin exam. A palace sounds like something that would need multiple people to summon unless they're just really top tier