I think I see the issue, you should press enter when near it to press the button, I should have made that clearer in game
