8 ms·
I have a close friend working in core research teams there. Based on our chats, the secret seems to be (1) massive compute power (2) ridiculous pay to attract t
by htfy96 2y ago
I have a close friend working in core research teams there. Based on our chats, the secret seems to be (1) massive compute power (2) ridiculous pay to attract top talents from established teams (3) extremelly hard work without big corp bureaucracy.
- deleted 2y ago[deleted]
- nomilk 2y agoIt was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). Will be interesting to see if the relationship between power/compute/parameters and performance is exponential, logarithmic or something more linear.
- ncr100 2y ago[flagged]
- zurfer 2y agoIt's logarithmic. Meaning you scale compute exponentially to get linearly better models. However there is a big premium in having the best model because of low switching costs of workloads, creating all sorts of interesting threshold effects.
- Davidzheng 2y agoLinear in what metric?
- 535188B17C93743 2y agoPresumably the benchmarks? I'm also interested.
- deleted 2y ago[deleted]
- energy123 2y agoIt's logarithmic in benchmark scores, not in utility. Linear differences in benchmarks at the margin don't translate to linear differences in utility. A model that's 99% accurate is very different in utility space to a model that's 98% accurate.
- Xelynega 2y agoNot really since both give you wrong output that you need to design a system to account for(or deal with). The only percentage that would change the utility would be 100% accurate.
- WanderPanda 2y agoYes, it seems like capability is logarithmic wrt compute but utility (in different applications) is exponential (or rather s-shaped) with capability again
- smeeger 2y agothis is like a caveman dismissing technology because he wasnt impressed with the wheel. its like buddy, the wheel is just the start
- zozbot234 2y ago> It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). IIRC achieving full AGI requires precisely 1.21 jigawatts of power, since that's when the model begins to learn at a geometric rate. But I think I saw this figure mentioned in a really old TV documentary from the 1980s, it may or may not be fully accurate.
- esafak 2y agoThe funny part was that none of his workers recognized the film, which was a blockbuster. A veritable "I must be getting old" moment.
- karparov 2y agoAnd fun fact, without govt subsidirles, a nuclear power plant isn't economically feasible, which is why Elon isn't just building such a plant next to the data center.
- hector126 2y agoAnecdotal, but I've gotten three recruiting emails from them now for joining their iOS team. I got on a call and confirmed they were offering FAANG++ comp but with the expectation of in-office 50h+ (realistically more). I don't have that dog in me anymore, but there are plenty of engineers who do and will happily work those hours for 500k USD.
- para_parolu 2y agoIf you can share: were these 500k cash or cash +rsu?
- sashank_1509 2y agoI have a friend who joined there with 2 YoE, and got fired in 3 months. He was paid 700k cash + 700k RSU
- saturn8601 2y agoSo in the end did he get anything? I dont know how these things work but did he just walk away with ~50k in pre tax income and 0 for RSU or did Musk pull a Twitter and not even pay him for those months?
- hector126 2y agoIIRC it was cash, but I'm sure others can confirm.
- iooi 2y ago500k isn't FAANG++, it's standard FAANG comp
- hector126 2y agoShould have been more clear, this was 500k for an E4 level role, you're correct that senior/staff at Meta and G are definitely making more.
- thefourthchime 2y agoNo a bad recipe for success.