I know same, it's just always slow. Have you figured anything out yet? If I do I'll tell you, but I can't find anything online to help yet.
The boat is always so slow, I'm not sure if there is a way to fix it but you can still clip through the wall without the speed boost. Just a lot slower :)