You are correct. Beerus was absolutely terrified to fight THE CHAMP. So he had to settle with his strongest disciples, Buu, Gotenks, Goku and Vegeta.

And once he dealt with those weaker disciples, the MIGHTY OOLONG.

Y'know this begs the question, who is the TRUE Guardian of Earth, Dende or Hercule.