3 ms·
Considering that AI is just "taking off" now, I'd say we're still pretty early in the growth curve (the alternate hypothesis, that people have been oblivious fo
by CuriouslyC 4y ago
Considering that AI is just "taking off" now, I'd say we're still pretty early in the growth curve (the alternate hypothesis, that people have been oblivious for a while, seems unlikely). Regardless, I think even if we were well into the linear portion of the curve, we could still do a lot with layers of tooling on top of marginal improvements on current models and technology.
- telotortium 4y agoWe're in the hype cycle now at the moment, but the capabilities have been taking off for a few years. GPT-3 came out in 2020, and in retrospect, could have been trained several years before that, given that the 175 billion parameters of GPT-3 turned out to be way too many for its level of performance (as discovered by Chinchilla). I agree that there are a lot of refinements that can be made even with the current LLMs, but it's unclear how far LLMs will continue to improve.