3 ms·

They already are. I have been using Kimi k2. It is 90% as good as Sonnet and on Groq 3x faster and 1/5th the price.

• pizzalife 1y ago
  What kind of GPU setup are you using for Kimi?
  • evandena 1y ago
    Sounds like he's using it on Groq, no self hosting.
  • moojacob 1y ago
    No, I don't self host. I use Groq.com as my provider.
• csomar 1y ago
  That's an interesting name to choose. For second there, I thought GroK enabled third-party models.
  • moojacob 1y ago
    Grok 1 was released in 2024, Groq was founded in 2016.
• OldfieldFund 1y ago
  isn't it Q4 quantized on groq?
  • moojacob 1y ago
    Groq says it's FP16.