You loose speed only when you don't boost with a double click (and hold it) 

I did it like that cause I wanted it to can be play on phone, unfortunately the UI is broken on phone 😭

I think I'm gonna do a picture tutorial next time x)