3 ms·
I find the quality ebbs and flows even on the same model. My guess it is something to do with GPU availability but only guessing.
by osigurdson 4mo ago
I find the quality ebbs and flows even on the same model. My guess it is something to do with GPU availability but only guessing.
- atq2119 4mo agoUnless you're systematically repeating the exact same task, the most parsimonious explanation is that you're seeing natural variation based on different tasks, random sampling of tokens, etc.
- osigurdson 4mo agoI don't think this explains the phenomenon as is more temporal in nature - not prompt to prompt. I'm sure the AI labs gracefully degrade to simpler models when resources are low - why wouldn't they?