I use lm studios with an 8gb vram, I run L3.1_8b_stheno, 4.9gb q4_k_m version.
L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B, 4.6gb isn't too bad either.
Idk for anything lower than 4gb vrams though.
