There is potential for a very fun game loop here! I enjoyed what I played, but if stopwatches were rarer and awarded more time, they would feel even better to collect.
I wonder if enemies could reduce your timer on hit instead of having a separate health mechanic. Just a thought!