The armor isn't that strong. It spreads the kinetic force out. But it does not stop a concentrated attack. Since he likens it to kevlar a directed, focused attack will pretty much negate the armor.

Every other character can overcome the armor relatively easily.