Apparently when you miss the date, your permanently locked out of the quest line. You have to go back to an earlier save
