So I've been using this for a few days, and it's quite a good app! But for some reason it's started to have trouble starting up sometimes, and when ever I try to chat it says "Error: model requires more system memory (9.2 GiB) than is available (4.7 GiB)"
I haven't downloaded anything else onto my computer since I started using this, so I'm wondering if I somehow changed a setting or something that might be causing this. Unless the chat's I have had are somehow lowering my system memory? I don't know much at all about programing or hardware, so I'm not sure what to look into.
I would appreciate any suggestions on how to fix this issue.
That worked! Thank you! I switched to a cloud LLM, and now it works. I did try to download the smallest LLM "Dolphin Phi v2.6 2.7B" but that had the same problem, so I guess I'll have to use the cloud for now. Unless the file size of the model isn't what I should be looking at? Sorry, I don't really know anything about this stuff.
I thought I had been using the basic downloaded LLM, but maybe not. If you have a LLM you'd suggest trying that would be nice! I have storage space, just not very good ram or memory. It would be nice to have something I could use if my internet dies, but no worries if theirs no downloadable LLM that would work for me.
Anyway, thank you for your work making this! I do appreciate your help and work. It's a great app, and nice to be able to relax and just do some fun writing in the evenings.
Also sorry for blabbering a bit. I'll stop myself here. Thank you again! And have a wonderful day!