No. When you start at level 1, its only an Attack penalty of -1 for a Damage Bonus of +2. It's only when your BAB reaches +4 that the penalty/bonus increases.