I've always been a proponent of the, "constraint breeds creativity" line. This feels no different to me. I think you made a solid decision, and have something you could keep iterating on with feedback. The feedback which is more likely to be plentiful due to your design decision! A loop of sorts.
I'm actually feeling really inspired by this jam, I'll probably write my own blog about it soon though.
Very cool! Can't wait to play!