It definitely works with the rolls too! I just dawned on me while reading it that the game could be run diceless.
I was thinking about that the other day while reading Sidney's Twitter thread about 3 Question Matrix, wargames, and OSR.
