I believe the latest hotfix fixed the issue. Sorry for the troubles. What made fixing this bug so hard is that somehow I cannot replicate the bug in my games, and I had many different game states running at once trying to replicate it to no success, and since reloading fixes the issue, that made it even worse.