Tried that. Doesn't work. Rather than mentioning security issues MacOS warns about the app being "damaged", therefore can't be opened.
Did you ever signed the app?
You can follow the steps in this video or use the itch app!
Sadly this issue will never go away because our game isn't signed and notarized and Apple really doesn't like that :)