3 ms·

> The hype follows what OpenAI's latest release does though Yes, because what OpenAI releases today helps us improve the prediction of what it may release in a

• groby_b 2y ago
  That is only true if you believe research never has dead ends and progresses on a well-defined curve. It does neither. What OAI or others release next does, in the very best case, help set a floor. And if it's a blind alley to a local maximum, even that isn't super-helpful.
• _heimdall 2y ago
  But how can we actually quantify the accuracy of said predictions? Each release of an LLM is largely a black box. We don't know exactly how they work, what they learned, why they learned it, or what their limitations are. How exactly does that help us predict what could exist in a decade or two? And how do we align that predictive ability with the fact that so many people working in the industry would not have been able to predict where we are today a decade or two in the past?