4 ms·
Pricing? Found it: https://mistral.ai/technology/#pricing https://mistral.ai/technology/#pricing It'd useful to add a link to the blog post. While it's an ope
by tinyhouse 2y ago
Pricing?
Found it: https://mistral.ai/technology/#pricing https://mistral.ai/technology/#pricing
It'd useful to add a link to the blog post. While it's an open model, most will only be able to use it via the API.
- MacsHeadroom 2y agoIt's open source, you can just download and run it for free on your own hardware.
- tinyhouse 2y agoWell, I don't have hardware to run a 141B parameters model, even if only 39B are active during inference.
- astrodust 2y ago"Who among us doesn't have 8 H100 cards?"
- MacsHeadroom 2y agoFour V100s will do. They're about $1k each on ebay.
- astrodust 2y ago$1500 each, plus the server they go in, plus plus plus plus.
- MacsHeadroom 2y agoSure, but it's still a lot less than 8 h100s. ~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
- astrodust 2y ago$8K sounds like a lot more than "free".
- theolivenbaum 2y agoThat looks expensive compared to what groq was offering: https://wow.groq.com/ https://wow.groq.com/