Thank you for playing the game and giving feedback. I am glad that you enjoyed the game. As for the "only one" mechanic we were going for the fact that you had to keep all the information in your head/on paper as you listened to one person and try to put where his dialogue goes in the story. But I can understand if people don't think it fits the theme that well.
As for leaving everything as it is and allowing you to only see the conversation once, that would fit the theme better, but in my opinion it would make the game more frustrating than it should be. But it would need to be tried to see if I'm right. Cheers.