[Incase you haven't figured it out by now.]
Need a minimum of three affection with Elizabeth. You get your first on day 2 if you answer the choices correctly. The second when you pay for the renovation of the lighthouse. Third you get on the Payment day if you answer the choices correctly. If you don't want to restart your save you should be able to get affection every payment day with the top choice.