Thanks so much for the feedback!!!
During development I was planning on improving this system, but I couldn't get it to work the way I wanted it. Because this was a game jam submission, I just skipped past it and would fix it at a later date, but as development went on I guess I just got used to the controls.
If I ever continue working on this game, I will definitely take this feedback into consideration and fix this!!