3 ms·

At that speed it's too pricey for agentinc tasks.

• yipinwong 1mo ago
  The target audience is who needs raw speed. Having the choice is good as you can make a trade-off between speed, perf, and quality. Until last year, people had a single AI god they believed in (mostly Anthropic stuff). Now we have power to make choices (open-weights, SOTA, speed-optimized, etc) the same way you do for system designs.
  • vb-8448 1mo ago
    It's not a criticism, I was really looking forward to trying out such a powerful model at this speed. But I burn my 5$ allowance in 10 minutes ... and only because I was hitting rate limits, without it would probably be less than a minute.
    • yipinwong 1mo ago
      I hear ya... the best option is to use company budget as normies will rack up ridciulous amount soon with that raw speed.