4 ms·
Thinking to add LLaMA or other OSS LLM models soon
by junhoyeo 3y ago
Thinking to add LLaMA or other OSS LLM models soon
- mkl 3y agoPlease consider LLaMA.cpp (https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp), which supports a lot of models and doesn't need an expensive GPU.