4 ms·
Hi there, I work for Groq. That's right. We love graphics processors for training but for inference our language processor (LPU) is by far the fastest and lowe
by tome 3y ago
Hi there, I work for Groq. That's right. We love graphics processors for training but for inference our language processor (LPU) is by far the fastest and lowest latency. Feel free to ask me anything.
- artninja1988 3y agoAre they only available on the cloud? Are you planning on releasing a consumer version?
- tome 3y agoMostly available as a service via cloud API at the moment. The systems themselves are too big for consumers but we will sell systems to corporations.
- mayli 3y agoWhat's the scale of hardware behind this demo, in terms of watts, transistors and cost?