[quote=@lavulman]
<Snipped quote by Card Captor>

Well, that tower is guarded by Dialga, and I know I was KO'd like five times just getting to that monster of a boss, so it's probably fine.
[/quote]

Not only that, but you'd need Dialga's permission to actually use said time travel. He's not likely to just allow some villain to time travel to this time or that.