4 ms·
Let’s take it a step further and accept some inaccuracy. If we apply the Pareto principle[1], we should get 80% of the accuracy for 20% of the size. Compoundin
by koolba 2y ago
Let’s take it a step further and accept some inaccuracy. If we apply the Pareto principle[1], we should get 80% of the accuracy for 20% of the size.
Compounding that four times, we should get .8^4 = 40% of the accuracy for .2^4 = .16% of the size.
That’d be about 1 GB for the current largest model.
[1]: https://en.wikipedia.org/wiki/Pareto_principle https://en.wikipedia.org/wiki/Pareto_principle
- regularfry 2y agoNo need to just use 80/20 as the split. The article says (on one benchmark) you get 97.3% of the accuracy for 50% of the size. So blindly applying Pareto you get (compounding nine times, because why not) 78% of the accuracy for 0.2% of the size. Something tells me that's a little optimistic.