I think most of the people who unilaterally say 'Yes, get vaccinated' probably haven't gone in for Anthrax. My short answer is they're not all created equal, and bad shit happens when you introduce things into your body. I mean I know a guy (former pilot in my unit, which is spanish for 'otherwise very healthy') who went blind in one eye from a 'FluMist' vaccine -- obviously not common, I'm just saying. Get the safe vaccinations and avoid the ones you don't need. 

TLDR: 'It's designed to be safe' is a poor excuse for doing your damn research. Only inject your infants with safe things.