Really cool concept! I love seeing all the creativity that goes on in jams like this, and you've definitely hit the theme perfectly here.
As your first game, this is a spectacular effort. All my first games were garbage, but you've made something that could easily be expanded to something amazing.
Jam games don't need to be polished. This is by no means a 'failed attempt'. Don't worry about your game not looking good (Hint: I'm not a graphic designer either). What matters is that you tried and you submitted something, which is better than most people could ever achieve.