3 ms·
> Covered models are those trained on more than 10²⁶ flops (a measure of computing power that, at current prices, is estimated to cost between tens and hundreds
by RcouF1uZ4gsC 2y ago
> Covered models are those trained on more than 10²⁶ flops (a measure of computing power that, at current prices, is estimated to cost between tens and hundreds of millions of dollars), or projected to have similar performance on benchmarks used to evaluate state of the art foundation models. If your model was trained on less than 10²⁶ flops and doesn't outperform those that were? It is not a covered model.
I think the number needs to be indexed to some measure of readily available consumer hardware.
Otherwise, there are lots of computing capabilities that were estimated to cost 10s or millions of dollars (for example, the first hard drives were tens of thousands of dollars for a few megabytes and a terabyte of storage would have seemed like an astronomical amount projected at 10s of millions of dollars. Also for a long time, a teraflop was considered to be an astronomical amount of computing power which a high end desktop or laptop can now easily hit).