Controller lag.
Some reason it starts building up over time. Happens to me on my Xbox one controller and on my keyboard. Seems to get worse over time.
Viewing post in Curse of the Nether Regions comments
This is an issue we are away of. It is unfortunately fairly rare and hardware dependent, caused by a bug in the engine runtime we used for this build. We are working on a bugfix patch on the newer runtime that will hopefully fix this issue for those affected. Sorry for the inconvenience. Out of curiosity, do you have an AMD graphics card?