You have to not get hit by the very faint translucent cloud sprites. Yes their movement is random, but the mushrooms shoot these clouds out in intervals, meaning you gotta time yourself.