Ok great visuals and the concept and my only suggestion was to move the camera movement from the update loop to late update in order to prevent the jitter.
There it is) Maybe smth with your device
Thanks for feedback!