I don't get what you exactly mean but did you ty to enable movement control in the options? It will allow you to move the world by using the grip button on one controller and moving it.
There is also a guide here who may help you : https://arvrtips.com/deisim-vr/