Clearly Oliver doesn't realise his position in the guild... With a simple few words everyone would give them privacy if he wanted. :P All of the ex-npc's are their loyal servants, gladly following orders of what they perceive as their almost divine creators.