3 ms·
A lot of organizations still think they should have their own [finetuned] model to provide a custom experience to their users, so that may come as a surprise fo
by rafaelero 3y ago
A lot of organizations still think they should have their own [finetuned] model to provide a custom experience to their users, so that may come as a surprise for them.
- ShamelessC 3y agoScaling laws basically guarantee that a sufficiently larger general model will usually beat a smaller specialist model. The misunderstanding is perhaps acceptable but the headline here is essentially restating a well known property of deep learning.
- __loam 3y agoHow long ago was the Bitter Lesson written?
- mistrial9 3y agocontrarian view - how these models actually operate at runtime is not understood.. the formal research papers repeat that over and over again. Therefore, there will be new twists and turns as these models evolve. With current technology stacks, the "bitter lesson" is looking good, yes. Will it always be so? no way to know it.