Oh, I wasn't even thinking the GM might mess with the high five, but that does open up some interesting possibilities.
It isn't really my intention that the GM refuse high fives---at least, not for the sake of stopping players from succeeding---but the GM proactively offering a high five or being reluctant to accept one could be used as a way to build tension and uncertainty.