3 ms·
> AI has reached a state of software issue, not hardware Citation very much needed. At the very least, OpenAI seems to believe more and larger datacenters is
by TheDong 8mo ago
> AI has reached a state of software issue, not hardware
Citation very much needed.
At the very least, OpenAI seems to believe more and larger datacenters is the path to better models... and they've been right about that every time so far.
- eitally 8mo agoMoreover, all the frontier labs and hyperscalers are capacity constrained, and will be for the foreseeable future.
- leptons 8mo ago>OpenAI seems to believe more and larger datacenters is the path to better models... Does that mean they produce better slop, or more slop faster?
- allreduce 8mo agoBetter slop. The effect that these systems get better as you scale up [0] is real you know. [0]: https://arxiv.org/pdf/2001.08361 https://arxiv.org/pdf/2001.08361
- leptons 8mo agoSlop is still slop. There is no legitimate evidence that these systems get any better just by throwing more hardware at it. Every one of the people in this paper is involved with OpenAI, so it is very suspect in its findings.
- df2dfs 8mo agoTheir story (valuation) hinges on it - therefore that’s their investment thesis when raising money.