Haha! Good point I underestimated how complex this would be for players. I had ideas to rotate the order of rooms but ran out of time (maybe a good thing). I guess the minimap on the left could also have been improved too to make it simpler.
I think it was just the right difficulty! I'm just imagining how tough the later puzzles would be if this was like a 10-20 hour game x_x