I'm glad you enjoyed it.
The use of the d4 is at the discretion of the table. Obviously it is impossible to stack something on a pyramid. It's a bit of a joke but I'm sure there are players who enjoy seeing how their teammates fail, after all that adds flavor to the adventure.