The Garth route doesn't prevent interactions with Egon, so it must have been something else you did.
I think it's because I rejected him at first and then taking the Garth route just lowered the friendship points even more.
