I think later, when they run out of food, they should have a hard time successfully hunting down enough creatures, and finding enough plants that are safe to eat. I think it would add to the difficulty.