I had the same problem as you for the looping music on web, on Godot you have a setting on your AdioStreamPlayer Node "Playback Type" and you must set it to "Stream"
Hope this can help ! ;)
oh that is great to know. I was looking on how to fix it but I was short on time. Thanks!
