They appear at the start of each round as per the Gremlin Groups table. They spawn adjacent to washtubs (no lore behind it; I think you can justify it by saying it's fey magic), except for the gremlins that spawn on a Tier 1 outcome—those spawn from underneath the ingredients that were used in the test.