I'd reserve jokes for sections in the game, where the player is in a calm environment. Contrast between a happy place and darker scary places. Or only add most jokes in new game+. This would encourage replaying the game. Because they really can break the immersion.