There is such a dissonance between gameplay built around interactions and gameplay built around inputs. It's the difference between a quick time event and a minigame, between a game and a UI.
I haven't properly thought about it, but what makes games like Edith Finch, or Papers Please, work so well is that they are producing the experience of an interaction, rather than just letting you press buttons. This is a really good manifesto.