3 ms·
Well right now, running this model is really expensive, but we should prepare a new cope for when equivalent models no longer are, ahead of time.
by Pesthuf 2y ago
Well right now, running this model is really expensive, but we should prepare a new cope for when equivalent models no longer are, ahead of time.
- cchance 2y agoYa getting costs down will be the big one, i imagine quantization, distillation and lots and lots of improvements on the compute side both hardware and software wise.