4 ms·
PyTorch was not in any stretch of the imagination a breakthrough, nor is an H100. Those are clear incremental engineering improvements. Notable ones yes, but de
by BoiledCabbage 3y ago
PyTorch was not in any stretch of the imagination a breakthrough, nor is an H100. Those are clear incremental engineering improvements. Notable ones yes, but definitely not breakthroughs.
The transformer paper is the only thing that absolutely can be considered a breakthrough and what commercial success or impact did it have before OpenAI? None.
He is absolutely correct. Silicon Valley had been chasing crap for years now like crypto or various forms of rent seeking "businesses", and making incremental improvements.
- PaulHoule 3y agoOn the other hand, put enough incremental improvements together and you've got a revolution. Seen that way, even OpenAI got where it is by standing on the shoulders of giants.
- PaulHoule 3y agoOn the other hand, put enough incremental improvements together and you've got a revolution.
- reducesuffering 3y agoI’ll bite. Then what are the inventions worthy of the term “scientific breakthrough” that Silicon Valley had, but not anymore? Does the freakin first mass produced EV in the world count? Engineering and manufacturing. Crypto is also an example of a much more globally distributed phenomena. Vitalik in Singapore, tether founders in Italy?, Binance god knows where, FTX in Bahamas, etc. None of the major tech co’s in the Bay were doing much of anything with crypto. Oh except for Coinbase, you know the YC darling of whom Sam is affiliated?
- twelve40 3y agothe reason many of the crypto geniuses and prodigies are "god knows where" is because it's harder to bring them to justice for their innovative scams
- m463 3y agoaren't the pc, the internet, the browser and webserver, the gpu and more all incremental improvements too? (not speaking about silicon valley)
- mempko 3y agoNever equate commercial impact with scientific breakthrough.