Admittedly once you get the heavy armour perk, steel hands I beIieve its called, unarmed attacks actually do a fair amount of damage.