I assume you're using Nemo, which has some trouble translating RP actions into game actions because it's ancient. Nemo will be replaced by something much better that works on 8+ GB VRAM cards soon.
I'm actually using Qwen 3.5. I think I need to go back to Gemma 2, because only with this AI i did get yes or no answers in the dialogue. I don't know why, but Gareth just refuses to give me the keys, even though RP says he's giving them to me. I've tried several approaches, but it's not working. By the way, does the house key appear in my inventory if I do get it? I'll try starting a new game with Gemma 2, and maybe he'll sell me the keys.
So, before that, I was using another model that generated text pretty quickly. But as I realized, the problem was with it. So I deleted it and started using Qwen 3.5. But apparently, the previous model was the one that broke the NPCs. As soon as I started a new game, I was able to buy a house from Gareth on the first try. So, everything is fine, and I'm just a dumb person. If you're interested, the fast text model was Tiefighter.