You can do what I use to do. I would usually lock away a character in Story Post until that person could return.
I would lock them away and give them two phases. If they weren't back, they would be killed off.