Oh yeah, a speedrunning timer would work amazing here, I think that would also fix it :D But yeah I can see that, getting people stuck because things are too difficult is definetly not the goal xD
And really feel it with the time, I wish my game was thrice as long as it turned out^^"