Cydonia-24B has been pretty good in my experience, though I did run into the same issue of it being a little slow, like you said. I will experiment with koboldcpp and add it in a future update if the quality is okay. Thanks!
hey if you need another tester for local Ilm, I got a 5060 to 16gb and so far I run 24 well in that area with fast speeds and even use an agent when I use marinara engine. I think the option of local would be awesome!
