3 ms·
well, I am not sure how small you can turn your 70b model into a small one, but its a great question for the Ollama creators: https://lu.ma/yourdatayourmodel ht
by torrmal 3y ago
well, I am not sure how small you can turn your 70b model into a small one, but its a great question for the Ollama creators: https://lu.ma/yourdatayourmodel https://lu.ma/yourdatayourmodel
- torrmal 3y agoactually, yes they do have support for Llama2 70B, you need 39GB of ram, compared to 130GB that it originally takes.