3 ms·
What happens with excess hardware that’s been already bought? It could take years for all of that to be absorbed by smaller companies. And secondly, if this ope
by elorant 2y ago
What happens with excess hardware that’s been already bought? It could take years for all of that to be absorbed by smaller companies. And secondly, if this opens the era of self-training models then why go for a 671B one and not a smaller that’s fine-tuned to a company’s specific needs and can then run on consumer GPUs. At 70B with 8-bit quantization you’re good with just three 3090s.
- pixl97 2y agoDeepseek isn't AGI yet and really still has a long way to go. Na, we have a long way to go with models, especially when you start adding different modes. We'll still need a metric shitload of compute for a long time.