Alright, that'll be useful. Because it can be really disappointing when the AI invents an NPC who you end up getting attached to, only for the AI to forget important details about them and screw up the description, even when the NPC never left your side! Tends to derail plots that way.
so what exactly do the memory and token settings in the endpoint menu do? I’ve noticed that, with meta-llama and a high amount of memory, I’ll be getting pretty good results, but then, after a while, the AI will lock up with an error message that it can’t connect and I’ll have to let it ‘cool down’ for a while before I can come back and keep going.