Is there something more than just a score adding up? like a boss or something? if so I didn't play enough
Yep! It's counting down, so once you reach 0 you win :) SPOILERS: there is a boss indeed, you have to reach the last fly (when counter shows '1'), once you beat it you win.
