You don't need to delete the old version, but I think you can.
Though we had a few issues with save files in the past, so new versions mostly come with a quick start option to the newest chapter anyway.
