3 ms·
Guanaco is indeed very capable and can replace GPT 3.5 in almost all scenarios, based on my tests. Easy way to self-host it is to use text-generation-webui[1]
by coolspot 3y ago
Guanaco is indeed very capable and can replace GPT 3.5 in almost all scenarios, based on my tests.
Easy way to self-host it is to use text-generation-webui[1] and 33B 4-bit quantized GGML model from TheBloke[2].
[1] https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
[2] https://huggingface.co/TheBloke/guanaco-33B-GGML https://huggingface.co/TheBloke/guanaco-33B-GGML