Nvm, solved it. The Linux version defaults to using the first audio device it seems (which for me is a monitor that doesn't have speakers), using pavu-control to change it to use my soundcard works.
I use Arch Linux with pipewire for audio if that info helps.
The audio in the Linux version doesn't seem to be working. I can run the Windows version under Wine and have audio work fine.
