oh that is very strange! if that happens again can you maybe send your save file to me? it is located somewhere in your local/temp folder
https://drive.google.com/open?id=174oDxKXIShxbUaUarFeyEK-jz9kbxRjY
The problem is not unique to the save - it starts happening when I get to around 2 or 3 towns.