3 ms·
I imagine Microsoft like any other bean counter company heavily quantizing the GPT models or whatever they use to serve it at scale with minimal cost.
by joot82 6mo ago
I imagine Microsoft like any other bean counter company heavily quantizing the GPT models or whatever they use to serve it at scale with minimal cost.