3 ms·
Is that possible? I thought parameter counts were fixed in the model.
by afro88 3y ago
Is that possible? I thought parameter counts were fixed in the model.
- fwungy 3y agoThere are always ways to trade precision for speed in computer statistics models.
- afro88 3y agoSure, generally speaking. Is that true for static, fixed parameter count LLMs like GPT4? I think you're hand waving a lot just to claim that OpenAI are (somehow) reducing accuracy of their models during high load. And I'm not sure why.