This is a bug, do you know when it happens? I’m trying to fix the issue.
To be honest, not really. It seems pretty random and happened to me a few times pretty early in the game (around day 3-4) and once around day 11. It seems it stops existing completely (as opposed to just not being visible), as the villagers are not able to store food inside. Reloading the game doesn't help.