It's a pretty cool idea, but it ends up being pretty tedious repeating previous parts everytime to reach the latest stage. I reached the question mark part and quit when I failed, because the puzzle's rules were not made clear enough and the brutal punishment for not completing it made it feel unfair.
I really liked the idea of having different variants of the same puzzle compose an entire game, so with some tweaks, I think it could be made really fun.