3 ms·
> This doesn't seem like a convincing argument that current ML techniques are tapped out. Absolutely right, I wasn't very clear -- I don't believe "current ML
by feoren 3y ago
> This doesn't seem like a convincing argument that current ML techniques are tapped out.
Absolutely right, I wasn't very clear -- I don't believe "current ML techniques" are tapped out. I do believe that we're not going to see a GPT5 for several more years, and a GPT6 for another decade+ (or if we do, it will be branding, not anything significantly better). We're at the top of the sigmoid curve for the benefit of just making bigger and bigger LLMs.