It was very fun! I like the creative idea
I think small tweaks that can change the experience a long way.
I agree with the small tweaks like remembering position and the direction, I would also add that the restart button is in the same position as the start button, so I won but accidentally restarted (maybe because I'm dumb) and had to win again at the beginning. Maybe switching places between the "restart" and "start new level" buttons?
That aside, it's a nice game! It's satisfying to win the puzzles :)