3 ms·
Groq is not general purpose enough, you'd be stuck with a specific model on your chip.
by maxboone 2y ago
Groq is not general purpose enough, you'd be stuck with a specific model on your chip.
- tome 2y agoI'm not sure what you mean. The GroqChip is general purpose numerical compute hardware. It has been used for LLMs, and it has also been used for drug discovery and fusion research (https://www.alcf.anl.gov/news/accelerating-ai-inference-high-throughput-experiments https://www.alcf.anl.gov/news/accelerating-ai-inference-high...). [I work for Groq.]
- tome 2y agoAnd just in case it's not clear: I'm saying Groq can be used for arbitrary AI inference workloads, and we aim to be the fastest for all of them. We're not tuned to any specific model.