I think I did start a new game before, I'm not sure what happen.
So now I redownload the game and started the route to get through Mikio's day 10, turns out I missed like this whole scene! The scene from the bamboo forest to the getting hired at the restaurant. I don't know where it branched off, but the sake scene was where I started from the first play through(weird). Anyways it worked! I got the memories to work thanks.