After playing AV, another visual novel by the creator, I couldn't exactly put into words why it made me feel so sad without anything explicitly sad happening. 

But The Day We is much more clear in how the author writes. Their stories make me feel sad because they work within absences - I miss something that isn't there because it was never written. I miss what I fill these absences with on my own.