Well, it is entirely up to you, but the jokers are there to protect you from what you put in the deck... so I'd keep them close to the problem ;)
