The trick I did was just to hold E at all times so I instantly started mining when I reached a rock. I did notice I mined faster over time, but not the movement speed.
