The thing that threw me off was that the bottom neurons look closer to the center than the bottom paths, so it took me a while to realize I had to go to the bottom, and even then, I still went to the center by accident. If you draw the neurons close to the bottom path, it'll feel a lot better.