3 ms·

He was responding to viral tweets[1] that said GPT-4 had "100 trillion parameters" and was "500x more powerful than GPT-3," which is indeed absurd hype. On the

He was responding to viral tweets[1] that said GPT-4 had "100 trillion parameters" and was "500x more powerful than GPT-3," which is indeed absurd hype. On the other hand, two weeks ago a team of Microsoft researchers put out a paper claiming that GPT-4 "could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system." [1] https://twitter.com/andrewsteinwold/status/1594889562526027777 https://twitter.com/andrewsteinwold/status/15948895625260277... [2] https://arxiv.org/abs/2303.12712 https://arxiv.org/abs/2303.12712

lm28469 4y ago
You're missing the end of the quote, a bit further in the next sentence: > including the possible need for pursuing a new paradigm that moves beyond next-word prediction. So all in all "it's not AGI and we might need a paradigm shift to achieve it" A paradigm shift being: "a fundamental change in approach or underlying assumptions."
- fiso64 4y ago
  Exactly... In other words, they say that they don't know whether this will get us to AGI.