Nemo should require 10 or so gb of vram. If it's using all 16 gb, you're probably trying to run the large Gemma 2, which will by default be painfully slow unless you have 24 gb, since it will offlload a lot of it to the slow normal ram.