Well, chances are you can just outright reject him. You can outright reject anyone. 

I would tell him you don't think he's cut out for the roleplay and explain why, in a decent way. The worst he'll do is get upset, but eventually get over it.