Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

Formamorph

Every choice transforms your body and shapes your adventure · By FieryLion

Anyone else having this problem where the ai keeps thinking its the start of the world over and over again?

A topic by HelioKnight created 23 days ago Views: 377 Replies: 4
Viewing posts 1 to 2
(+1)

So I'll freely admit I have no idea how this game works or how ai models work. I'm using the LM Studio for a custom ai model since the base one can barely handle anything beyond very basic worlds before it says it hits a memory limit. Well now after like 7 to 10 prompts it just bugs out and starts acting like the world started over from the beginning and it keeps doing that even if I try to continue after. It didn't use to do that and I have no idea why it's doing that now, even worlds I've made that have a lot of info for detail used to work fine but now they do this too. I haven't changed the ai model I use (and yes I tried other models but they either suck and don't output what I want or they have the same problem) and I'm still using 1.1.9 because 1.1.11 has this problem naturally built into it with that memory bar thing. If anyone has any idea what the issue could be I'd be grateful cause it's really annoying. The ai model I use is gemma-2-9b-it-Uncensored-DeLMAT-GGUF by mradermacher.

It sounds like it's a memory issue. LM Studio has a built-in failsafe that triggers when the memory available to the language model becomes too small for the amount of data it wants to store. In this case, it trims out some of the data to make way for the new stuff. The default setting in LM Studio is that it will trim out the middle, leaving the start (typically the world rules and entities) and the end (at least the very last recorded chat) intact. The rest gets thrown out, which could explain why the AI thinks that you are at the start.

If it is that, you should try and see if you can't increase the allocated memory so that the model can remember more. Within LM Studio, when loading up the model, you should change the "Context Length" to a higher value. Maybe try doubling it for now.
You will have to apply the same number in-game under the "Max memory" setting so that Formamorph knows how much memory it has available.

Ok I'll try that

That definitely seems to have helped. I still don't understand why this started happening because it didn't used to do that before.

(1 edit)

I can say with 100% certainty that it is better to use free models via openrouter(there is guide on the main page) rather than running small models on your computer.  To run smart and big models you need a high-end PC and small models, although they work, do not always do what you tell them and  poorly follow the narrative