there are indeed infinite pieces, you have to manually end the Build Mode with X when you think you're ready. maybe that should be changed?
i had no idea you could end it, so you should probably make that clear ingame or at least in the instructions.
There was a message for it but it was easy to miss. I've now updated the game so that the tutorial forces you to press X too, teaching you this mechanic.