Thanks for checking it out!
We added a feature about an hour before submission to solve that issue but its not super intuitive. You may have noticed that when the damage becomes lethal, a red crystal with an X on it will spawn - if you hit that into the vortex it will speed up the attack!
I might be releasing a post-jam update, if i do i'll make that gem look less 'negative' :)