[@Inkd Bull]
Just had an idea
What if for those spirits that are more tangible it takes energy to go through walls...
So if they go through multiple they will be pretty wiped out/tired and need to rest 

Just thinking of ideas lol