The idea is good, but it gets really tricky not being able to move backward. Maybe if the character could move backward automatically and an invisible wall stopped them at the exact point, that could be a solution I can think of.
But everything else is very well executed.