That was one of the initial mechanics we thought of, but as we were getting closer to finish the jam, we started to simplify things in order to be able to submit the game :S
It needs more polishing in general, thanks for your feedback! :)