[@Shoryu Magami]
It'd be even more unique to make a manga or light novel with music. Perhaps not physical books, but online stuff if you get what I mean. Either way, with a light novel, you can express stuff in a way that not only doesn't require music, but can even be better without it. As I've stated before, Re:zero does this perfectly. 

As for the writing with music thing. I don't know, maybe I am weird on this one, but I cannot write with music. I can read, work, draw, etc, but I cannot write with music. Perhaps I could if I were physically writing like on paper, but not typing on a computer.