Yeah, I'm not too comfortable in large groups so I'd prefer to keep at least the one I'm in at 3 members.

That's fair.  No pressure either way, pick whatever group you want.