4 ms·
Groq Raises $640M to Meet Soaring Demand for Fast AI Inference
- htrp 2y agoDupe https://news.ycombinator.com/item?id=41162463 https://news.ycombinator.com/item?id=41162463
- pryelluw 2y agoNo pricing page?
- sronors 2y agoGated by login: https://console.groq.com/settings/billing https://console.groq.com/settings/billing
- bhouston 2y agoNot Elon Musk’s grok? Because this one has a q at the end? So confusing. Someone should trademark in force the other.
- swalsh 2y agoYeah, this one needs to be resolved. It really is confusing since they're in the same space.
- trenchgun 2y agoGroq actually has a competetive edge about something, unlike Musk's "Grok"
- burkaman 2y agoIt is incredibly confusing, Groq was first (by a lot) and they did write a nice letter (https://wow.groq.com/hey-elon-its-time-to-cease-de-grok/ https://wow.groq.com/hey-elon-its-time-to-cease-de-grok/), but understandably they probably don't want to burn money suing the richest person in the world.
- TiredOfLife 2y agoGrok was first by about 50-60 years.
- TiredOfLife 2y agoGrok is a word made up by Heinlein about 10 years before Musk was born.
- mdhb 2y agoIs there something special about this unlike the million other AI companies that justifies putting some company’s press release on the front page or was this the result of unnatural voting patterns?
- sva_ 2y agoIt's a hardware company and justified to be on HN imo. They're doing interesting stuff.
- jjice 2y ago$640M of fundraising seems notable enough for this level of HN attention.
- mrtksn 2y agoAFAIK they are a hardware company producing special chips for processing AI tasks. Their response time is incredibly fast, like 500t-900t/s for LLMs. They're not just a company that buys in Nvidia cards for serving as a backend. In other words, they are competing with Nvidia, not the million startups using Nvidia.
- deleted 2y ago[deleted]
- zaptrem 2y agoI don't understand why all of their hubub is about tokens per second (which relies on a lot more than just hardware) instead of FLOPs/memory bandwidth/etc.
- consumer451 2y agoThey do make their own hardware, but of note is that they stopped selling hardware and instead pivoted to only selling API access, 4 months ago. Hence no need to describe anything aside from tokens/sec? https://news.ycombinator.com/item?id=39964590 https://news.ycombinator.com/item?id=39964590
- 2y ago
- deleted 2y ago[deleted]
- eigenvalue 2y agoI have to say that I would much rather invest in Groq at a $2.8b valuation than NVDA at a $2.55T valuation. Hard to imagine a world where those two numbers are both correct at the same time.
- daghamm 2y agoHow are these two comparable? Nvidia has tons of other products, and they have been delivering AI accelators for many years now. Groq on the other hand is basically a gamble at this point.
- erichocean 2y agoWorking hardware is a gamble? As a developer, I'm thrilled they'll be increasing capacity.
- uncivilized 2y agoOne company has a history of generating revenue, the other doesn't.
- deleted 2y ago[deleted]
- uncivilized 2y agoIn literature on the financial markets, authors routinely discuss how retail will decide to invest in companies in less time than it takes them to order lunch, or in this case write a comment on a forum. This comment is the epitome of that considering how Groq has near zero revenue while Nvidia brings in close to $100b annually with over 50% profit margins. This is how both numbers can be correct at the same time.
- eigenvalue 2y agoYeah, except I worked for a decade doing investment management at large hedge funds. And I'm also very familiar with the product offerings of both companies and think Groq is on an extreme growth trajectory. NVDA is extremely overvalued right now based on optimism around AI compute. If that optimism is warranted, then Groq is likely to 10x or more from here in the next few years.
- consumer451 2y agoFor additional context, here is the popular post for when they first gave a public demo of their API: https://news.ycombinator.com/item?id=39428880 https://news.ycombinator.com/item?id=39428880