You need to successfully complete the other routes and then select the new option that appears on the first day when in the carriage with you brother.
You can find more details on this here: https://blackcross-taylor.com/the-rose-of-segunda-walkthrough/
Please let me know at support@blackcross-taylor.com if you need any more help ^_^