You also spawn at the same horizontal position you jump off at so you choose the spawn point. Not that it fully solves the issue though...
