The more your dig power grow the more it lags at around 2000 worms on the worm garden "map" it becomes unberable.
I think it's the 3D map, it surely looks cool but it's something that is likely making the game lag.