...........

sorry to break it down on you but we already have someone like that xD

And even if the familiars had different magicks, it wouldn't affect you cause you are only feeding their magic, not actually casting it in your body. 

I won't stop you if you want to make a character like that and it is completely okay, so go ahead.