Hello, will there by support for koboldcpp, its working way better for me than ollama in different tasks
Viewing post in ❓ Questions & Usage Help
Hi! KoboldCpp should already work with Thaluna — no separate support needed. It connects through the existing Custom OpenAI-compatible Local API option.
Just start KoboldCpp, then head to Settings → Ollama / Local API in Thaluna and fill in:
- Base URL:
http://127.0.0.1:5001/v1 - Model ID:
koboldcpp - API key: leave it empty
Then pick "Local API: OpenAI Compatible" as your translation model and you should be good to go!