It's very hard to get it right, I didn't manage it in the end. It's too unclear for me how well the sound is in the center. Maybe a more extreme attenuation effect will help, I'm not sure.
But nice game! Good work on the sound design. Explanation was clear. Game loop definitely has potential!