3 ms·

I believe it when I see it. Lot's of companies in the field now and if I need to take a bet I would say Intel has way better chances to succeed with Gaudi than

• two_in_one 3y ago
  Because it's not just a chip, it's everything else too. There were 2 startups in Boston, may be 500 meters apart, doing optical computing. 4 years and there is still no product. "everything else" is a lot. It's hardware and software. Just brilliant idea is not enough.
  • visarga 3y ago
    They are delivering Groq cards, nodes and rack. Not vaporware. See an article from the press with details here: https://www.theregister.com/2020/09/29/groq_ai_dev_kit/ https://www.theregister.com/2020/09/29/groq_ai_dev_kit/
    • two_in_one 3y ago
      this is more recent and optimistic https://www.nextplatform.com/2023/11/27/groq-says-it-can-deploy-1-million-ai-inference-chips-in-two-years/ https://www.nextplatform.com/2023/11/27/groq-says-it-can-dep... But I don't see any selling numbers or independent performance conformations.
      • tome 3y ago
        > independent performance conformations. Groq has just been added to the LLMPerf Leaderboard: https://github.com/ray-project/llmperf-leaderboard#output-tokens-throughput-tokenss https://github.com/ray-project/llmperf-leaderboard#output-to... (Disclosure: I work for Groq)
• visarga 3y ago
  That's why I provided the demo link, see the tokens/second. They are running LLaMA 70B at about 260T/s without quantization. This is the fastest LLaMA2 model