3 ms·

Not surprising at all. As a former Google employee, I'm regularly in contact with friends still at Google and the number of hardware engineers OpenAI has hired

by kccqzy 2y ago

Not surprising at all. As a former Google employee, I'm regularly in contact with friends still at Google and the number of hardware engineers OpenAI has hired out of Google have drastically increased in the last few months. You can readily see for yourself just by browsing LinkedIn and looking at profiles of hardware engineers currently at OpenAI and noticing how many of them are former Google employees. Google's own TPU team is now a shell of its former self. I wouldn't be surprised if future Google TPUs are inferior to the new OpenAI chips. Also, did you know that Google's TPU efforts previously also relied on help from Broadcom? https://www.theregister.com/AMP/2023/09/22/google_broadcom_tpus/ https://www.theregister.com/AMP/2023/09/22/google_broadcom_t... It's absolutely unsurprising that former Google employees would bring this vendor relationship into their new company, given Broadcom did a good job helping Google with TPUs.

NitpickLawyer 2y ago
It's also worth mentioning that google spent a lot of time (and probably money) and human capital on their TPUs and slowly got there. Other companies that have a proven track record of hyper-scaling also tried and missed (tesla) so it's not as easy as locking a bunch of phds in a room and have them crank out LLMs. Hardware is finicky, slow to develop, slow to prove itself and extremely expensive.
mindentropy 2y ago
BRCM is becoming more like a service company designing ASICs for other companies who want custom ASICs. There are many companies who do this? How is this news? BRCM is a leader in SerDes along with Marvell and other companies. There is so many IPs from Synopsys and Cadence that in turn many of these chip companies use. Not sure what is hoopla here. Nobody is going to completely vertically integrate all these IPs.
- wmf 2y ago
  It's news to people who know nothing about hardware.

by kccqzy 2y ago

NitpickLawyer 2y ago

It's also worth mentioning that google spent a lot of time (and probably money) and human capital on their TPUs and slowly got there. Other companies that have a proven track record of hyper-scaling also tried and missed (tesla) so it's not as easy as locking a bunch of phds in a room and have them crank out LLMs. Hardware is finicky, slow to develop, slow to prove itself and extremely expensive.

mindentropy 2y ago

BRCM is becoming more like a service company designing ASICs for other companies who want custom ASICs. There are many companies who do this? How is this news? BRCM is a leader in SerDes along with Marvell and other companies. There is so many IPs from Synopsys and Cadence that in turn many of these chip companies use. Not sure what is hoopla here. Nobody is going to completely vertically integrate all these IPs.

wmf 2y ago
It's news to people who know nothing about hardware.