There should be another plant, next to the one that makes your balls big, that returns them back to normal when you interact with it. If that doesn't work, use the masturbation emote and make Nene cum. This should return them back to normal and you won't have the slow debuff anymore.