hey if you need another tester for local Ilm, I got a 5060 to 16gb and so far I run 24 well in that area with fast speeds and even use an agent when I use marinara engine. I think the option of local would be awesome!
Hey ElPapaDon! I added local LLM support in v0.1.2. If you try it out, please let me know how it goes and what models work well
gotcha! ill give some feedback as i have today off so ill be touching upon this game alot xD
