Ohh, I think I know why. I was trying to close the speech window by pressing E, but it closes by itself. So when I pressed the key it opened again.
Still good feedback. I didn't realize that would cause confusion. Thanks! I can fix that pretty easily.