4 ms·
The updated "partial credit" metric proposed by the researchers suggests that LLMs will continue to improve as parameter count increases (assuming you have the
by abound 3y ago
The updated "partial credit" metric proposed by the researchers suggests that LLMs will continue to improve as parameter count increases (assuming you have the data to make use of XX trillion parameters). It's just showing that it isn't as "step-wise" as other rankings may have indicated.
- anon291 3y agoIt still is stepwise for the kinds of use cases being envisioned. For example, it's useful to know your 1 trillion parameter self driving car model is actually 90 percent of the way there, but it's also useful to know that the threshold you need to meet to implement the technology will likely be met at some point when your parameter count increases.