If you’re using a tablet or something similar instead of a mouse for the puzzle, this might be part of why it felt hard. My tablet really dislikes drag and drop mini games unless I disable Windows Ink. I always started with the face, it made it easier in my experience