I like the idea, but it definitely needs a lot more polish. For instance, the walls aren't solid. I can just walk right through. Using dice to power your actions in a dungeon crawler has potential for some interesting gameplay mechanics. I'd be interested to see what you come up with.