There's no real limit. Last time, I tried to have a sort of false limit by having the main character split up his team, and even appointing someone else as the leader of that splinter team...
but it didn't go over very well.