I had one lazy fix that actually helped with a lot of my problems, I just made the player a child of the level and it handled a lot of the headache for me actually. It created plenty of headaches as well though...
