Ok so I restarted the game, and the reason why I couldn't complete that objective is because for some reason the scene where MC stumbles upon Ryoko training never happened. That scene triggers a quest when upon completion also completes the "Spend time with Ryoko" objective.
I hope this helps someone with the same problem in the future lol.