The lack of option to get off the horse was intentional, but may be amended in a future addition. I'm happy to see you like the game, if you want to make more suggestions, I welcome you to my patreon https://www.patreon.com/thelastyurisamurai
