Saves and persistent data like what CGs you've unlocked are stored in a separate area of your computer than the game itself. As long as you don't go into that separate folder to delete the saves, you can open them in new versions of the game when those versions are released. So it's okay to completely delete the folders that contain version 0.1.3 or earlier and then just open version 0.1.4.