Thanks jscottk! Really useful feedback!
I have updated the project now so getting stuck in front of the the turrets is fixed. Now the rotation keeps going in the relevant direction if your hand is at the far left or right of the detection zone. This should help with the tracking loss as well.
I'll be uploading more updates so will keep you posted!