You still need a personality. So unless it's one of those "XXX outside of duel, but uber-focused and serious in duel" types, I see absolutely no reason to decline this character.