I'm trying to do exactly that. But I told the people joining that they have to be okay with the Slice of Live genre because I want to feel that their characters are super grounded in reality before they get thrown down the rabbit hole. It's an experiment at this point, because I've never done anything like this before. But basically between their roleplaying the GM (me) pulls up scenarios or instances that change the setting. Overtime I plan on it becoming more sci-fi/fantasy like.