4 ms·
Please consider LLaMA.cpp (https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp), which supports a lot of models and doesn't need an ex
by mkl 3y ago
Please consider LLaMA.cpp (https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp), which supports a lot of models and doesn't need an expensive GPU.