Nice little puzzle game! What I suggest is
1) Save last player config on level restart - this makes the UX more friendly
2) Use SPACE for jumping (because button control is painful)
Also, the theme doesn't feel implemented, but it's ok, nice work!