You can turn off the music using Settings > System Settings > Sound SXKeep in mind that this will disable sound effects as well.
