Yeah we can stick with that for now, you can bring in a second character later.  Really I'm fine with mashing timelines, but Rogue and Gambit might not be old enough for Oliver to work, and having Oliver come from other parents does kind of going against the character himself.