Not sure what caused the problem (the unwanted .rpy file) but after deleting it the game seems to working fine (so far at least).
There is only one game folder and at first the game would only open .txt file, not Renpy. I doubt the problem was caused by the remains of an older version...but of course I could be wrong. I am using the Itch.io App though...so problem might be related to that.