Two reasons I can think of. 

1) Security. That way only someone equipped with a reactor can operate a suit. Perhaps the reactors are even coded for the particular suit that belongs to the user. 

2) I recall in the movies when Stark was working on things he'd often plug them into the reactor in his chest. It's a reliable portable power source.