I spotted a bug. I was able to move in a way so that when the ghosts follow me they run into each other and be stuck there forever.