3 ms·
I thought we’ve seen diminishing returns on benchmarks with the last wave of foundation models. I doubt we’ll see a linear improvement curve with regards to pa
by dartos 2y ago
I thought we’ve seen diminishing returns on benchmarks with the last wave of foundation models.
I doubt we’ll see a linear improvement curve with regards to parameter scaling.
- Bengalilol 2y agoAnd now we have the LLMs self feeding their models (which may be either good or bad). This shouldn’t lead to short-term wide (as in AGI) efficiency. I bet this is a challenge.