The broader the advantage is, the weaker its effect. 

Lv.3 swordsman will be evenly matched against lv.3 strength and agility character if he fights with a sword, but he'll also have 3 more points to spend on other advantages, while the other character can also use his advantages to spring, jump, do a backflip, but not as fast or as far as someone who has athletic or acrobatic specific advantage of the same level.