You've got a strong concept here, with a lot of mechanics to play with. I can see a ton of different levels, puzzles, and setups that you could make with this. With some post-jam time to polish it up, I think you could have something really neat here.
I did also run into a bug where dice would sometimes go through walls, and once a dice kept moving without stopping, and I wasn't able to pick it up again.