Maybe the ghosts could be faster? currently they play at 1/4 speed, so you have to spend a while waiting for them. would that help?
I would consider drawing some sort of constant line for where the player will travel, and maybe show the path of the sword in a similar way that adjusts immediately when the player is changing things, so the player can work faster.
