Thanks, that was really helpful! I actually managed to find the issue with the help of your input, really appreciate it.
It won't be until the end of the game jam that I can upload the fix, but I hope the issue should occur fairly rarely...
Thanks again for reporting!