The concept could definitely go somewhere with the small mechanic set you have so far. Though it's a bit finicky because of the boxes and such being based on physics which leads to a decent amount of randomness which definitely does not help. Some finer points:
- The weird visuals didn't really help in that they were all in separate art styles which lead to a lot of conflicting images etc.
- The music got repetitive relatively quickly so maybe mixing it up, either with a longer track, messing with the pitch or something like that.
- As I said the fact that a lot of it is based on physics based items it leads to a lot of randomness. So maybe tweaking some of the physics to make a more reliable system would help. I think it would improve the gameplay a lot. Removing random restarts all over.