At first I was really confused about what to do after getting the gems, I was assuming that I'd get another tower, so I pressed every button I could think of! But then I figured out that I had to move the tower over to upgrade it.
It's a great concept, I'd love to see this fully realized with more time. It's very hard, but not in a bad way. I was more successful each attempt.
Good job!