4 ms·

was said about computers only 50 years ago, it's worth thinking about (tho probably too speculative at this point)

• SketchySeaBeast 4y ago
  Sure, computers are, but the really important ones - the ones that can perform the biggest calculations, make the fastest trades, mine bitcoin fastest, and now run the heaviest AI models - aren't. Capital always gives advantages, many of which are sizeable. There's a reason that the new AI hotness has investments in the billions.
• Ekaros 4y ago
  On other hand we are currently hitting limits or at least we see them. And we have some picture how much resources is required to train and run these models. So I think we could draw some conclusions with spending let's say 1000 and a million to run one or have one available.
  • smt88 4y ago
    > we have some picture how much resources is required to train and run these models This is the key detail. Even if the software gets 100,000 times better, the training data is still a major limitation. We can't get 100,000x (or even 10x) more data because the current training set is: - thousands of years of historical text, photos, and user-generated data (trillions of person-hours of work) - not yet polluted by AI So while I don't think we know the hard limit of the software, we're close to the hard limit for the training data and we'll also never have "pure" (not ChatGPT-filled) data again.