That's intentional. It's the main catch of the puzzle.
I see, I was able to finish the game, it was good.