4 ms·

Yep, Groq is one example

• BoorishBears 3y ago
  Great example: can't scale enough to remove their 30 requests per minute (!) rate limit and enable billing, barely meets 3.5 levels of intelligence, etc; People don't seem to understand that scaling out LLMs efficiently is it's own art that OpenAI is probably learning lessons on faster than anyone else
  • kaibee 3y ago
    You're thinking of Grok. Not Groq. Blame Elon for this naming catastrophe.
    • BoorishBears 3y ago
      Lol what? No, I'm thinking of Groq. I love Groq though, every time someone hypes up their project using it you instantly know they have no real usage whatsoever. Even the most "toyish" toy project doesn't fit in their rate limits for anything more than personal use.