I had a difficult time with the physics of the ball. I had one instance where I was using the red tube, the ball went in the tube, then proceeded to roll back up out of the tube (I was not rewinding). Also, sometimes my hand would accidentally grab the remote when I was trying to grab an object in the world.
Other than that, I can see the potential of this project. I like the use of the spatial data, and especially the use of the secondary screen.