He missed that his head-mounting wall was missing Oromis and Glaedr, apparently he wasn't omniscient =D I'd say that it might have been for the same reason why he left Surda alone - he didn't consider them a threat.