5 ms·
By now, model lifetime inference compute is >10x model training compute, for mainstream models. Further amortized by things like base model reuse.
by ACCount37 9mo ago
By now, model lifetime inference compute is >10x model training compute, for mainstream models. Further amortized by things like base model reuse.