Clark didn't enjoy being laughed at over a simple misunderstanding and so, before the goron even finished speaking he turned away and went to a corner table to enjoy a bit of peace and quiet.  At least he hoped there would be some here, further away from the barkeep.  

That and he was in a testy mood.  He tapped his foot at his table, which normally he wouldn't do but in his bad mood he expected the barkeep to come to him and quickly.