Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

sorry, not really an ollama user. It's just worse if you're not using it a server that LM Studio. That being said, I just compared the speed and the RAM and VRAM footprint and it seems to be the same indifrent of what KV cache quant I chose. That's not really how these things are suposed to work. dunno any other way to test it thoug. I mainly use GUIs and stick as far away from the terminal as I can. Actually installing and uninstalling Hammer AI's flatpack is the most usage my terminal has seen in months. :)

As for other infrence engines for tti models, Automatica's SD webUI is still in active development but it's not the best. Forge has a fork but it's far from the same quality as the original since the original forge was made my a literal genius with a PhD and all. ConfyUI is the prefered infrence engine for most desktop and laptop image generations since it's the most efficient. The easiest way to install any of them on a PC would me Stability Matrix if you want to do some testing.