You can turn the music off in the pause (P/Enter) menu. 😀
Edit: Turns out the Music: Off option wasn't working properly, it's sorted in 1.02! :)
