Fun concept! Sadly the "game engine"-less approach is holding you back since it didn't feel responsive enough, like I clicked but it didn't always do anything? Cool that you did it in Java though, good job!
a fun and useful fact about java:
you need java to use java, and if you already have java and it isn't working, you are using it wrong
i hate java