Hm, i really liked the idea but was surprised to finish it after the third or so level. Its hard to not get the controls mixed up. After playing i still feel the pressure of these like "oh no, black player left BLACK PLAYER LEEEFT" moments when the timer is ticking and ticking.
I think you could really do some fun stuff with this mechanic and it fits the theme really well. You could vary the timer for levels more focused on "getting to each other in time" and other levels focused on "getting the jump right".