It's really well balanced that way. I never felt too unfairly pushed away by my ghosts. The times I got moved made the game the good kind of chaos.
