Unfortunately, this problem will remain in the game for a long time. We have found the reason and we will be able to fix it only after switching to another game engine. It is written in more detail in our discord.
https://discord.com/channels/951222108195782757/991602983571836980/1421095613784...