I'm going to second this. It's actually kind of frustrating when going for the higher endless levels. I just end up having a lot of fun building out an ideal bag, and then it crashes and all my progress is lost. It's a little demotivating for me, tbh.
It's kind of a catch 22, because the issue slowing down the frame-rate is probably having too many objects, however, because each of the candies have their own stats, it would be difficult to manage it if they weren't individual objects. It might be cool to have "ghost" candies become a single stacked item, especially for the "clone by draws" type candies. From what I can tell, once a ghost is spawned, that ghost and any copy of that ghost will have the exact same stats, so the clones of clones don't actually need to be their own objects, it would probably cut down on the total assets on the high score rounds immensely.