I played a bit more and found the game does want to slow down severely after several minutes on a flood, like the cache is not getting rid of entities. Especially happens with stone blocks forming then being broken into small particles, even if those don't stay they slow the game down a good bit, but it still happens over time with summoning and fighting going on until I go to the next floor.