The main problem is a lack of control, which I understand is the point of the game. However, in my opinion some out-of-the-box thinking needs to be applied to make this lack of control into a fun experience. As it stands, it's a cute minimalist top-down navigation puzzle, but just unable to get anywhere anytime quickly.
Since the idea of making randomness determine the movement isn't fun for me, I'd instead give the player complete control, but the dice rolls automatically and changes modifiers about the player (inverse controls, disabled after next button press for 5 seconds, fast motion, slow motion, etc).
What I can't deny is that finally getting to the goal does feel satisfying. Perhaps the concept has some fun appeal after all, but the level design might need to change to accommodate it (wider hallways, bounce pads on some walls, stuff like that).