4 ms·
> Large models are for querying the model > Small models are for querying the context I respectfully disagree. My experience is that large models are capable
by thimabi 1y ago
> Large models are for querying the model
> Small models are for querying the context
I respectfully disagree.
My experience is that large models are capable of understanding large contexts much better. Of course they are more expensive and slower, too. But in terms of accuracy, large models are always better at querying the context.