No, speed doesn't affect cooldowns, only skill LVL in most cases does.
Are you playing on the phone?
Edit: Yep, you are right.
>It just seems at some point the number of hits increases permanently(until I close the game)
Turns out, Navy set 2x bonus stacks until restart. That's why you get all those hits. :^)