Without the rocks and wood etc being different sizes, it became more of a memory game than a guessing game. I like the idea of it though, reminds me of the "what's heavier, a kilogram of feathers or a kilogram of steel" meme.
The A and E button inputs combined need a bit more of a window so you don't have to get them frame-perfect. Some simple background music would also be nice between the dings.