4 ms·
You've got to understand, proprietary models operate as the following: - release: full precision, debrided, uncapped context - shortly after, hooked: quantize
by hirako2000 3mo ago
You've got to understand, proprietary models operate as the following:
- release: full precision, debrided, uncapped context
- shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread.
- down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing.
Rince and repeat.
- klipklop 3mo agoThey have to be doing some variant of this in the life cycle because of how wildly the performance changes over time. I refuse to give Anthropic my own money because the subscription plans are essentially useless. It's rather nice with a company API account with no spending limit though. But really oAI models are more consistent over time in my experience.