Well in this X-Men is just more an all encasing term.  Since mutants in general means super powered people.  So even though people like Peter or Nathan wouldn't count, they do here.  So Peter is technically already with the X-Men in this.

The X-Men are also a division of SHIELD too, so even if you were moving Peter from one to the other it wouldn't take much.