Have you tried the Unreal Engine 5 version? Physics is much better on that version and you have access to it.
Viewing post in How to get a more realistic experience?
The UE5 version will replace the Unity version on all platforms when ready, the physics is much better. Anyway a good start is to play with the drag factor and the motor power.
- Less drag factor == faster but harder to stop drone
- More drag factor == slower drone, more responsible, stop quick
You can also play with weight and the gravity.