3 ms·
My Llama is huge! 70B parameters....Maybe I should try Ollama...
by iain1992 3y ago
My Llama is huge! 70B parameters....Maybe I should try Ollama...
- torrmal 3y agowell, I am not sure how small you can turn your 70b model into a small one, but its a great question for the Ollama creators: https://lu.ma/yourdatayourmodel https://lu.ma/yourdatayourmodel
- torrmal 3y agoactually, yes they do have support for Llama2 70B, you need 39GB of ram, compared to 130GB that it originally takes.