I realized that the game might be a bit confusing, but other than the UI that states the color itself, there is another one that states whether to follow the visual color or the actual word stated on the text! This could be why you kept dying after the 4th pellet as this randomization only happens only after the 4th one.