The inventory essentially. I feel like it ruins the flow for me. Another suggestion is you could even possibly make it easier to interact instead of completely removing it.
Mmm... gonna have that in mind, and see what comes out.
