4 ms·
Hi. Are these ASICs only for LLMs or could they accelerate other kinds of models(vision) as well?
by karthityrion 3y ago
Hi. Are these ASICs only for LLMs or could they accelerate other kinds of models(vision) as well?
- tome 3y agoIt's a general purpose compute engine for numerical computing and linear algebra, so it can accelerate any ML workloads. Previously we've accelerated models for stabilising fusion reactions and for COVID drug discovery * https://alcf.anl.gov/news/researchers-accelerate-fusion-research-argonne-s-groq-ai-platform https://alcf.anl.gov/news/researchers-accelerate-fusion-rese... * https://wow.groq.com/groq-accelerates-covid-drug-discovery-333x-versus-legacy-solutions/ https://wow.groq.com/groq-accelerates-covid-drug-discovery-3...
- karthityrion 3y agoSo, is this specific chip only for LLMs as the name LPU suggests Language Processing Unit, right?
- tome 3y agoThe chip is capable of running general numerical compute, but because we're focusing almost entirely on LLMs at the moment we've branded it the LPU.