Thanks Amos, that was really helpful!
I remembered that we were experimenting with an mkbundle build, so I added that executable and .sh file to the itch portable. Now it launches correctly in v23 without needing/prompting the user to install Mono. So we're all good here :)