It's probably that I didn't get the correct way to play this game, but it feels more luck dependant than it should. Throw the top dice away and keep control for the button stack means you can't keep a rolled dice and use that value for buttons.
I think this idea has a potential to become a good puzzle game.