Tony was in the middle of a fight with LOki when he felt the panic set in. Even if it was dangerous, he just took off not knowing if Loki would follow. Everything was just too much now.
He went back to Stark towers and curled up on floor.