So sorry to hear that! Being a speedrun type of game, we found it difficult to communicate to the player on the mechanics.
Try to press your right click ability while you're traveling to another soul. You have to be somewhat close, so try to get the timing down and you'll feel the difference!