Oh, it seems I understand what's the reason. At some point the guards can syncronize their movement, misleading one to thinking that they're syncronized in general.
An intendent solution is to wait some time and catch a moment when the closest guard goes to the right, but the farthest guard still looks to the left.
Sorry, I didn't try to make precise timings, there's an extra margin for intendent solutions.