5 ms·
Deepseek seems to prove there's no super secret sauce that makes these models irreproducible outside the US and that the companies here are suffering a bit from
by rtkwe 2y ago
Deepseek seems to prove there's no super secret sauce that makes these models irreproducible outside the US and that the companies here are suffering a bit from the glut of cash/credits leading them to burn tons of extra processing power that could have been optimized away.
- ArtTimeInvestor 2y agoDeepSeek has been trained on US hardware.
- rtkwe 2y agoUS hardware in what sense? My understanding was it was trained on spare compute owned by the parent company but I didn't bother looking that deep.
- ArtTimeInvestor 2y agoTrained on Nvidia GPUs.
- rtkwe 2y agoThe US AI industry does have easier access to them but again Deepseek proves countries outside the US can get enough access to them to produce similarly powerful models. Unless the US really clamps down on exports of cards, which will be hard given they're made overseas and only designed in the US, it's not like they're a unique resource only US companies can access.
- 827a 2y agoA nice model, does not a billion dollar company make. The hard part of AI is not the model; Apple needs people to do the 80% rest-of-the-work; how do you make AI useful to the average person? How can we get inference on edge devices as cheap and efficient as possible? Models are boring. Everyone fully expects that we'll see an N% increase in intelligence every six months now. Yawn. The exciting thing now is: What are we using AI for?
- rtkwe 2y agoSpending a couple billion dollars also doesn't make an actual billion dollar company. It's yet to be proven that all this spend on LLM training and running can actually get translated into an actual profit.