Shelter is capable of preserving life experiences as a consequence of absorbing mana, because...that's what mana is. It has no effects on memories, other than on Skies Ablaze.
I think it was explained that because each shell has some of Luke's mana, that is why people can see memories from others' perspectives. (which is why he keeps getting flashes when he's on the roof, where mana particles aren't absorbed)