You should just replace the old version with the new one, you could delete old folder freely.
Games based on RenPy engine store its save files in the system folder, like AppData/Roaming, so you can't accidentally lose saves even if you'll erase the game. Saves will be found automatically.