I think Robert is equally bad at fighting both Grimm and humans. Only capable of winning in most fights because he had an advantage in say stealth or prior knowledge of his opponents' weaknesses and strengths.