Those GIFs are looking great! I'm getting a "Hocus Pocus" vibe from them in a good way, don't know if you ever played that old DOS game.
Personally, I'd optimize the game for whatever control scheme you feel best suits it. It doesn't make sense to sacrifice fun just because PCs can have multiple control schemes --- there are plenty of games out there that say "controller recommended" or "mouse/keyboard recommended."