Thanks for giving my game a try, and nice thoughtful feedback!
And, yes, the restriction is part of the puzzle mechanic, but it seems like it's too clunky at the current state.