8 ms·
No general model is the frontier. Thousands of small, specific models are infinitely more efficient than a general one. The more narrowed the task - the bette
by Artgodma 2y ago
No general model is the frontier.
Thousands of small, specific models are infinitely more efficient than a general one.
The more narrowed the task - the better algorithms work.
That's obvious.
Why are general models pushed so hard by its creators?
Their enormous valuations are based on total control over user experience.
This total control is justified by computational requirements.
Users can't run general models locally.
Giant data centers for billions are the moat for Model creators and corporations behind.
- azan_ 2y agoIt's neither obvious nor true, generalist models outperform specialized ones all the time (so frequently that it even has its own name - the bitter lesson)
- Artgodma 2y agoSo you think that one general model can outperform thousands of specific ones in their specific areas?
- maleldil 2y agoCertain desirable capabilities are available only in bigger models because it takes a certain size for some behaviours emerge.