Annoying is definitely the selling point. Forgiving for sure, but it's just not enjoyable to place gems into the sockets and trying to put them into the box due to wonky physics.
Despite that, this is a pretty forgiving experience. Never lost to any of the levels so the whole thing is trivial at best.
I at least didn't waste too much time so it's okay for a short game.