8 ms·
Deepseek just released their frontier model that they trained on 2k GPUs for <$6M. Way cheaper than a lot of the big labs. If the big labs can replicate some of
by clayhacks 2y ago
Deepseek just released their frontier model that they trained on 2k GPUs for <$6M. Way cheaper than a lot of the big labs. If the big labs can replicate some of their optimisations we might see some big gains. And I would hope more small labs could then even further shrink the footprint and costs
- cruffle_duffle 2y agoI don’t think this stuff will be truly revolutionary until I can train it at home or perhaps as a group (SETI at home anybody?) Six million is a start but this tech won’t truly be democratized until it costs $1000. Obviously I’m being a little cheeky but my real point is… the idea that this technology is in the control of massive technology companies is dystopian as fuck. Where is the RMS of the LLM space? Who is shouting from every rooftop how dangerous it is to grant so much power and control over information to a handful of massive tech companies, all whom have long histories of caving into various government demands. It’s scary as fuck.
- lodovic 2y agoThis is just a tech race. we'll get affordable 64 gb gpus in a few years, businesses want to run their own models.