X3: Albion Prelude is an improved version of Terran Conflict. If you're going to go backward in the series, X2 is about as far as I'd go. You lose too many convenient things going past that one.

I dunno how I feel about X: Rebirth, their newest game. I need to play it more.