4 ms·
Is there something special about this unlike the million other AI companies that justifies putting some company’s press release on the front page or was this th
by mdhb 2y ago
Is there something special about this unlike the million other AI companies that justifies putting some company’s press release on the front page or was this the result of unnatural voting patterns?
- sva_ 2y agoIt's a hardware company and justified to be on HN imo. They're doing interesting stuff.
- jjice 2y ago$640M of fundraising seems notable enough for this level of HN attention.
- mrtksn 2y agoAFAIK they are a hardware company producing special chips for processing AI tasks. Their response time is incredibly fast, like 500t-900t/s for LLMs. They're not just a company that buys in Nvidia cards for serving as a backend. In other words, they are competing with Nvidia, not the million startups using Nvidia.
- deleted 2y ago[deleted]
- zaptrem 2y agoI don't understand why all of their hubub is about tokens per second (which relies on a lot more than just hardware) instead of FLOPs/memory bandwidth/etc.
- consumer451 2y agoThey do make their own hardware, but of note is that they stopped selling hardware and instead pivoted to only selling API access, 4 months ago. Hence no need to describe anything aside from tokens/sec? https://news.ycombinator.com/item?id=39964590 https://news.ycombinator.com/item?id=39964590
- mrtksn 2y agoMaybe because that's how its measured in the LLM community? It's all about tokens per second.
- elorant 2y agoThey provide those numbers too. Memory bandwidth is at whooping 80 TBs/second.