Done! You can now download a ZIP file, uncompress it to your USB drive, and run it off that.
The software still saves its configuration to the C:\Users\<username>\AppData\Roaming\Kamoly folder, as that should have file permission access without elevated privileges. The configuration file is very minor - is it the first time running, are you in dark mode, recent campaigns opened, last volume setting, etc. So it shouldn't be issue if that is recreated on any new computer you use.
I am concerned Windows may still want to block the executable (and its required dlls) when you download it from the Internet. In that case you have to individually right click on the file, go to Properties, and select "Unblock". However, it did not do it in my test so that may not be an issue for you.
Please let me know how it works out for you, enjoy!