6 ms·
>Do LLMs have all these variances in their model accounted for? I would say "they can, yes" but more importantly "nobody knows what it accounts for or what the
by Groxx 3y ago
>Do LLMs have all these variances in their model accounted for?
I would say "they can, yes" but more importantly "nobody knows what it accounts for or what the accounting decides".
You can experimentally probe it of course to get some ideas. But in practice nobody knows it completely, and can only make semi-educated guesses, not accurate predictions.
(Intentionally ignoring small/toy systems that can be fully understood)