NPCs don't really count toward the limit.  For instance, I already had Hugh and Sanguin before I made Ronin.