Just found the issue as I was trying another Unreal Engine Game. In my audio settings the speakers where set to 32bit, 384000hz. After setting it to 16bit, 48000hz the problem went away. Will retry the game in a bit.
