The girl and the guy are both afraid of disappointing their master. As for Grora and Wodahs... I'm not sure. It's never explicitly stated what they are afraid of, but I guess you could say that they're afraid of war.