Plus carrying around a staff and dressed in robes just scream "MAGE" and we might want to go incognito until we can get a convincing cover. Sure we might not know how to use a sword, but would you think a mage would know how to use a sword? If he had one, would you think that he's a mage?