Honestly, if anybody needed to roll for Arma trying to sneak down into the hole, I imagine it'd be Arma, having to roll Stealth against Passive Perception. 

But yeah, I also agree that the players should be able to just kind make it happen without rolls if we want it to happen. xD