What I usually do is download the new version and while I have it open I delete the old one. Still the save files are saved in LocalLow (use %appdata%), so deleting only the game folder should not delete them.
