Thanks for the feedback Thoof!
Unfortunately I was using Unity's physics system, which is a bit... complex to configure perfectly. So I did my best with the rotation speed hehe.
