3 ms·
> do you need to run every small problem through a 10B-30B model? ... We're asking frontier Opus/Fable models to classify text Actually probably yes: text anal
by mdp2021 4mo ago
> do you need to run every small problem through a 10B-30B model? ... We're asking frontier Opus/Fable models to classify text
Actually probably yes: text analysis (magazine articles) by LLMs in the ~30b .. ~120b range failed miserably (and also randomly - the rare cases of proper interpretation occurred among the failure cases) with the main public models of around one year ago, tried extensively.
So, yes, you can employ an ~80IQ only if you will expect the related quality.