3 ms·
Torrent is probably the most appropriate tech to distribute these models. They're just big, and the audience to consume them is relatively small, tech savvy, a
by thelastparadise 3y ago
Torrent is probably the most appropriate tech to distribute these models.
They're just big, and the audience to consume them is relatively small, tech savvy, and has access to compute and network resources.
- dragonwriter 3y ago> Torrent is probably the most appropriate tech to distribute these models. I dunno, I think Git with Git LFS and a nice web interface is a pretty good way, and, look: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 And also, I suspect more useful for more people here: GGUF, from 2-bit to 8-bit, https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/tree/main https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGU...