3 ms·
This problem is even more pronounced with LLMs. If we train them on lots of average text, how could they ever write something extraordinary, or even give useful
by js8 3y ago
This problem is even more pronounced with LLMs. If we train them on lots of average text, how could they ever write something extraordinary, or even give useful advice? They don't reflect which training data are garbage, and they don't have any aspirations to excel.
- stevefan1999 3y agoRelated: https://en.wikipedia.org/wiki/Regression_toward_the_mean https://en.wikipedia.org/wiki/Regression_toward_the_mean