Given how vague Itch has been about games being removed and refunds, I'd recommend all creators with currently delisted games should remove sales and disconnect their payment processors.
Itch has stated that if a game is removed then all purchases will be refunded. They have not made it clear if the refunds are until the date the rules changed to exclude certain content or for all transactions over the lifetime of the game. The one thing that is clear is that these refunds are likely to just be processed without warning from the creators payment processor meaning people could potentially lose years worth of sales instantly.
Edit your game, at the bottom is Visibility. Normally you'll be set as Public. Click the bit next to it to customise permissions and check the box to stop further sales. Then in User settings remove whatever payment processor is linked.
Hopefully this should protect you until things actually get resolved one way or another. If your game gets relisted then set things back up again, but as I see it currently anyone with a delisted game is at risk of potentially thousands of dollars of refunds getting taken.