Managed to shift the angle of the world by standing halfway through the portal and then rotating it. Hard to explain exactly how to do it but you will know that you did it when you are popped back through to the opposite side you are on (as indicated by the model being moved and the sound que) when you rotate the portal.
