I liked the concept, and I liked seeing so many dice roll around :)
The game lagged very hard at times. How many polygons are those dice? And did you use a meshcollider instead of a box collider? Or is it the creation of the dice that is causing the lag? In that case, you might consider disabling the dice instead of destroying them, and sending them to a pool to be reused.