3 ms·
How do you turn down the fit quality of a static model?
by afro88 3y ago
How do you turn down the fit quality of a static model?
- fwungy 3y agoReduce the parameter count. Increase the acceptable error. The more parameters on a curve fit the better the fit will be, but the compute power increases too.
- afro88 3y agoIs that possible? I thought parameter counts were fixed in the model.
- fwungy 3y agoThere are always ways to trade precision for speed in computer statistics models.
- afro88 3y agoSure, generally speaking. Is that true for static, fixed parameter count LLMs like GPT4? I think you're hand waving a lot just to claim that OpenAI are (somehow) reducing accuracy of their models during high load. And I'm not sure why.