I'll just post an idea borrowed from Baba Is You:
Holding the button takes you back one block at a time faster and faster.
