Adjusting the volume in the settings panel does effectively change the volume, but does not stop the audio from being glitchy. The audio sounds like it's blown out. I didn't catch this the first time around but I think this is affecting the UI noise too. The SFX seem fine.
And I'm on Windows :)