Cool! I think that's pretty neat. Do you mind sharing what the local LLM is trained on? I think this is a really neat technology to implement in the game, though I am curious since the writing style is pretty unique!
I am used the model Phi3.5 of microsoft, a very small model trained on data that have been curated to allow to train small LLM to be coherent. I think the dataset they used is inspired by the dataset called “TinyStories” (textbook or children stories like text generated by larger LLM). This curated dataset allow the model to write relatively coherent text while the specific tone and style then come from the system prompt I give to it (old english, cryptic sentence, low-fantasy medieval context, …).