It's only if Yin herself does something, similar to how invisibility would work in a normal party comp. As long as she doesn't attack or cast spells she'll remain invisible.