3 ms·
but for code llm to be useful , the local machine need to have some very powerful GPU
by yangcheng 3y ago
but for code llm to be useful , the local machine need to have some very powerful GPU
- jasonjmcghee 3y agonot true anymore. give codellama-7b-instruct a try. Just install Ollama. Pretty mind-blowing performance for the ram it uses and how fast it is. It's in the ballpark of chatgpt-3.5-turbo for code related stuff