Cool idea, I wonder if giving the player some indication of when the time swap will happen could help. I was a bit confused to start when the scene kept changing, I almost thought I was encountering a bug.
