Guys seriously I can't stop think about this 
Magic needs to come with consequences 
The consequences have to be painful
It's the only way a force like this could exist in the universe 
Aside from a shorter life span how else could magic adversely affect them??