4 ms·
Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case
by mountainriver 1y ago
Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case
- attemptone 1y agoWe were talking about linear improvements and I have yet to see it
- mountainriver 1y agocheck the benchmarks or make one of your own
- attemptone 1y agoI checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
- mountainriver 1y agoon what benchmarks? pretty much every major one is linear improvement