Congratulations Yes you did. I am not sure why that was the only encounter you had though, unless somehow all the memories that were close just got forgotten, which is probably possible i guess.
Considering you did blame him, I would recommend checking out this one memory though. You can find that one at basically the beginning of the game. After you get in that portal and reach the first scene just go full left from there. You should reach it.
Good luck and thanks for playing.