This usually happens when you prioritize defense against a monster over guessing the number. Depending on this, the timing can vary greatly.
