What engine do you use?
Try to deload anything not on screen, and only load things when they are close-ish to the screen.
