You will probably need to restrict the level more, I usually rotate around in a square in front of the goal until I have the one dice at the right position. Prevent this from happening (narrow corridor with some restricted movement). Think the level as a puzzle and then make it. If you have more than one solution each time (like 2 or 3) it's even better :)