That was a cool and fun gimmick, and one of my favorite uses of the limitation I've seen so far! Though I didn't get to the end because moving objects (especially smaller ones) can get very finicky and I run out of time before I can get anything done.
Maybe instead of a time gauge, you could have a limited number of "moves" per stage? It could also be nice to display how much you have left even when time isn't frozen. Either way, nice premise, would love to play an expanded version of this.