4 ms·
A possible counterpoint here is The Unreasonable Effectiveness of Data by Halevy, Norvig and Pereira. https://static.googleusercontent.com/media/research.googl
by bunderbunder 2y ago
A possible counterpoint here is The Unreasonable Effectiveness of Data by Halevy, Norvig and Pereira.
https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/35179.pdf https://static.googleusercontent.com/media/research.google.c...
Say what you will about the merits of this paper, it's hard to deny that it has been influential within the deep learning community.
- rolisz 2y agoThat's a bit outdated. At the scale LLMs are trained, quality starts to matter again.