I like the idea of it, one of the things that i was struggling with at first was input timing but then after 2 rounds I learned I could just hold the input I wanted to go to and once the opening was there it would go regardless. I think maybe some variance in speed in the guards could make it a bit more challenging
EDIT: Looked at the comments after posting this and noticed you mentioned the movement thing.