I believe this was intentional, it would be nice to see an option to choose between physics dragging and it being auto-held.
