Found out most of the MacOS exports aren't working due to a bug in Godot. Looks like .zip exports on MacOS are not setting the executable permission on the ... well, executable. Supposed to be fixed in 4.x release.
Oh I see, thanks! Well, I'll leave it up but with a note that says it doesn't work. Maybe some people have some success running it.