3 ms·
Basically just run ollama and run the quantized models. Don't expect high generation speeds though.
by ActorNightly 1y ago
Basically just run ollama and run the quantized models. Don't expect high generation speeds though.
loading thread…
3 ms·