The real challenge is getting a hit with that charged up attack, to use maybe a bad example, imagine if Piccolo had missed with his special beam cannon. The fight would have ended badly for them right there. 

And he did indeed need Goku to hold his brother still for him to power up his special sauce.