Godot has a problem with .ogg files not looping in a web build. This can be fixed by calling the finished() signal from the AudioStreamPlayer and simply playing it again through code.
Definitely not the worst problem that a web build can have though… They tend to just completely break sometimes :D