I think it's because I rejected him at first and then taking the Garth route just lowered the friendship points even more.