I feel that it's a good concept for a complete game, but I don't feel like the theme is there, I don't recommend you to make the player stop holding the mouse (that is important to the gameplay) to press keys like "H" or "J", instead, it would be better to make a puzzle that makes you spam the mouse buttons or the spacebar that already has my left hand on it