Love the idea on the gameplay. One improvement I can recommend is maybe to add different effect of the dice hitting on the enemies which depends on the dice face
