3 ms·
Thank you, I've been doing guided exploration of the various quantized models with the help of Gemini (which is highly ironic, but effective.) It does seem lik
by julianlam 6mo ago
Thank you, I've been doing guided exploration of the various quantized models with the help of Gemini (which is highly ironic, but effective.)
It does seem like 16GB is on the extreme lower end of being able to produce capable results, very much like a junior dev, so much oversight is needed.
A tight code-test-fix loop seems to be the way forward.