Post by AbsolutelyNotYourBusiness in Multiic comments

Viewing post in Multiic comments

Is there any way to speed up answering time on Local model ?

That has no quick and simple answer :-) I suggest you take a look / ask around on Koboldcpp's github (https://github.com/LostRuins/koboldcpp/discussions), or https://www.reddit.com/r/KoboldAI/

Thanks, I'll give it a look !

I knew some Kobold, and for what I remember, it was slow and tedious.

I guess there are reasons about why it is no more used when you can avoid it.