I figured it out, it happens at low fps, near the monitors it drops a lot. I just walked away from the monitors and waited in the corridor where I have no problems with fps and Kerfur successfully completed his task.
