Thank you very much!
I've been secretly working on an "arcade" mode that will be in the "RetroPie" edition I'll release this 2024. This mode will "fix" some the things you mentioned ;)