What operating system are you on? Did it start happening after anything in particular or was it just random? To me it sounds like there's something going wrong when loading the game settings.
If you're on Windows, try going to AppData\LocalLow\frogmakesgames\A Very Ordinary Elevator Simulator and delete settings.save (and controls.save if it's there). If that doesn't work, try deleting the whole A Very Ordinary Elevator Simulator folder in AppData\LocalLow\frogmakesgames (you can back up your save files before doing this if you want, just put all the saveslot files somewhere safe). Also definitely try reinstalling the game if you haven't already.