There's a bug with saving the edited keys when you start the game, just noticed it.
Additionally, there's a known bug that occurs when attempting to change Button A, which happens because it collides with its intended use, namely, changing the key assignment.
I strongly recommend using the default keys or a controller. At some point, I look forward to fixing this mess of key assignments.
Sorry for the inconvenience.