Oh,hmmm...
I can think of two scenarios...
1)you need to blink(uses left mouse button, it is explained in controls page from the game), and reset your "panic state" which makes your character go "less crazy" .
2) after you look at him and he dissappears, you need to actually go to your leftmost and you will see him staring! And that's when you successfully obey the instruction!
When you mean "game ended", is it a crash or game over screen?