4 ms·
It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (
by nomilk 2y ago
It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). Will be interesting to see if the relationship between power/compute/parameters and performance is exponential, logarithmic or something more linear.
- ncr100 2y ago[flagged]
- zurfer 2y agoIt's logarithmic. Meaning you scale compute exponentially to get linearly better models. However there is a big premium in having the best model because of low switching costs of workloads, creating all sorts of interesting threshold effects.
- Davidzheng 2y agoLinear in what metric?
- 535188B17C93743 2y agoPresumably the benchmarks? I'm also interested.
- deleted 2y ago[deleted]
- energy123 2y agoIt's logarithmic in benchmark scores, not in utility. Linear differences in benchmarks at the margin don't translate to linear differences in utility. A model that's 99% accurate is very different in utility space to a model that's 98% accurate.
- Xelynega 2y agoNot really since both give you wrong output that you need to design a system to account for(or deal with). The only percentage that would change the utility would be 100% accurate.
- WanderPanda 2y agoYes, it seems like capability is logarithmic wrt compute but utility (in different applications) is exponential (or rather s-shaped) with capability again
- smeeger 2y agothis is like a caveman dismissing technology because he wasnt impressed with the wheel. its like buddy, the wheel is just the start
- zozbot234 2y ago> It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). IIRC achieving full AGI requires precisely 1.21 jigawatts of power, since that's when the model begins to learn at a geometric rate. But I think I saw this figure mentioned in a really old TV documentary from the 1980s, it may or may not be fully accurate.
- esafak 2y agoThe funny part was that none of his workers recognized the film, which was a blockbuster. A veritable "I must be getting old" moment.
- karparov 2y agoAnd fun fact, without govt subsidirles, a nuclear power plant isn't economically feasible, which is why Elon isn't just building such a plant next to the data center.