4 ms·
We were talking about linear improvements and I have yet to see it
by attemptone 1y ago
We were talking about linear improvements and I have yet to see it
- mountainriver 1y agocheck the benchmarks or make one of your own
- attemptone 1y agoI checked the BlEU-Score and Perplexity of popular models and both have stagnated around 2021. As a disclaimer this was a cursory check and I didn't dive into the details of how individuals scores were evaluated.
- mountainriver 1y agoon what benchmarks? pretty much every major one is linear improvement