The gollum analyzed the stone before it was tossed, assessed it wasn't a threat and allowed the stone to hit the Paragon. The stone disintegrating into tiny pieces of gravel on contact. 

The golem turned its focus towards Nemo, and send a physical punch in Nemo's direction.