[quote=@Lucius Cypher]
I've forgotten, but have we been to the first floor? I've been operating on the premise that we started from the bottom and worked our way up, but this guy is heading down back where we came from, right?
[/quote]

Hopefully this helps give the floor plan of the building:

3rd Floor - teleport room (everyone else)
2nd Floor - messhall and barracks (Orchid, masked man, kobold, Azzen, Celeste hiding)
1st Floor - entrance and storage room 
Basement - prison