You can turn off the music in the main menu. 

It's under the sound effect volume control, looks like a note.