Following Bowser's last acquisitions, I'm going to go ahead and say the few remaining spirits from the right-handed battle timed out and  faded away. But never fear, there will always be more chances to get loot.