This is a good idea for a game, the main mechanic feels good.You should continue this, but choose a better aesthetic/theme, while keeping the core mechanic and juicing it up.
I'm glad you think the mechanic feels good! That was my main priority, and why I recommend using a controller.
I think you're right about changing the theme after the jam. It it definitely needs some work, maybe a total reskin.