You can safely delete the game folder, download and unzip the new version. Your save files are stored in the AppData folder, not in the game folder, and will be detected automatically.
However, I'm not sure if the save file will become corrupted if you start from such an old version.