3 ms·
> It climbed to 84 tok/s, then hit a wall, insisting further optimization was impossible. > Hours later, Anthropic rolled back invisible LLM development safegu
by scotty79 4mo ago
> It climbed to 84 tok/s, then hit a wall, insisting further optimization was impossible.
> Hours later, Anthropic rolled back invisible LLM development safeguards, and it hit 255 tok/s.
Wow. Limitnig access to models for other reasons than that you can't physically provide it should be a crime against humanity or the planet or something. So much immediate efficency left on the table for stupid reasons.