There is a lot of control being offered to the player without difficulty to compensate. Like the bad and good spaces seem like good ways to augment the player's strength but with the ability to choose where you land it only really adds a reason to change up rolling a 6 every time as you target good spaces and go over bad ones. Other people commented on the way this game strays from the dice theme which I agree with even despite having randomly generated levels. An easy fix in my mind is to have the worm start at a random number every time and force the player to adjust their number on the fly which might address the awkward difficulty situation as well.
Can't say I have played a game like this before though and its strengths of balancing calculated moves with a rush to move forward are so satisfying! Such a winning formula with many ways to expand it if you were to update or target a full game release which I'd be excited to play. You already have tons of great art assets, lighting effects, and overall polish to work from which is quite impressive as a jam game. The worm character is so charming and a natural fit for a theme so heavily tied to numbers 1-6 as well as your gameplay requiring constant grounded forward movement or crawling. The variety in blocks also surprised me as it felt sufficiently random for multiple playthroughs and led to fun experimentation in the 2-10 minutes that most people will give a jam game.
Adding a score at the top is such a great motivater in these endless games that I wish more people included and while I don't understand entirely how it was adding points, it was an exciting experience to roll and then get to watch the score go up as the worm automatically moved forward. That score counter made the waiting portion of the game actually fun and felt like a subtley genius addition to your concept.
You did a great job overall and really impressed me as a somewhat experienced jam dev!