The doppler effect was actually a Unity built-in feature I discovered by accident. I was just messing with the audio source component to make the sound directional, and whatever I did also added the doppler effect. I agree that it was super funny to hear distorted music when you are actively being thrown around, so I decided to just keep it.