If you wait for him after letting him go he shows up at the cave entrance if you wait for him. If you didn't wait for him at the entrance he is gone
