5 ms·
If you read on, Groq said they would only sell hardware to US companies and outside companies would get cloud services, not the LPUs. I think the US government
by theturtletalks 3y ago
If you read on, Groq said they would only sell hardware to US companies and outside companies would get cloud services, not the LPUs. I think the US government told them to keep the LPUs in-house since they could be the secret sauce for scale.
- creato 3y agoI'm not questioning the deployment strategy, I'm wondering why Saudi Aramco wants to access so much compute power that is highly specialized(?) for generative AI workloads. Or is it more general than that?
- aleph_minus_one 3y ago> I'm wondering why Saudi Aramco wants to access so much compute power that is highly specialized(?) for generative AI workloads. Or is it more general than that? For vanity reasons and because AI is the future (not every company acts that rationally for huge buying decisions).
- brookst 3y agoAlso diversification. They’re smart people; oil isn’t the future. Comparatively small investments to hedge make perfect sense.
- theturtletalks 3y agoMaybe Saudi doesn’t want to rely on OpenAI and other APIs and wants to run a fine-tuned Mixtral model on the cloud or their hardware. International companies will probably opt for an open source model since the data is sensitive and OpenAI could pass that to intelligence.
- thawab 3y agoIt’s about material discovery[0], Aramco built a 250b model to help them improve efficiency [1]. [0] https://deepmind.google/discover/blog/millions-of-new-materials-discovered-with-deep-learning/ https://deepmind.google/discover/blog/millions-of-new-materi... [1] https://www.aramco.com/en/news-media/speeches/2024/leap24--remarks-by-amin-h-nasser-saudi-aramco-president-and-ceo https://www.aramco.com/en/news-media/speeches/2024/leap24--r...
- mike_hearn 3y agoWhat's the connection there? The second link says it's not about materials discovery at all but rather their GigaPOWERS model, which is a physics simulation used to optimize CO2 injection into their fields (i.e. optimizing recovery). POWERS is old, it was in development for decades already. Given that they don't plan to use Groq for LLMs but simply for its parallel computation abilities. I wonder to what extent this deal - if it goes through - will seriously drain Groq, actually, as POWERS would not be like the code Groq was designed to run and so much of their performance comes from the way they tightly optimize for very specific calculations.
- tome 3y agoHi there, I work for Groq. Groq's system was designed to run arbitrary high performance numerical workloads. In the past it has been used for a variety of scientific computation tasks, including nuclear fusion and drug discovery. https://www.alcf.anl.gov/news/argonne-deploys-new-groq-system-alcf-ai-testbed-providing-ai-accelerator-access-researchers https://www.alcf.anl.gov/news/argonne-deploys-new-groq-syste...
- thawab 3y agoIt's an assumption from my side, that they will utilize GenAI in material discovery for Aramco or SABIC[0]. Even if Groq won't fit that use-case a couple of billions with another hardware vendor is nothing if this paid off. [0]https://en.wikipedia.org/wiki/SABIC https://en.wikipedia.org/wiki/SABIC
- recursivecaveat 3y agoPartly supply-chain security I imagine. If generative AI does indeed become the next big thing much nicer to have a giant pile of hardware physically in your country than buying a drip feed from a foreign company.