4 ms·

Reading comments from the appropriate VPs will illuminate the situation.. Swami is looking to democratise AI, and the company is geared towards that more than a

Reading comments from the appropriate VPs will illuminate the situation.. Swami is looking to democratise AI, and the company is geared towards that more than anything else. Disclaimer; I work for amzn, opinions my own. https://aws.amazon.com/blogs/machine-learning/aws-and-mistral-ai-commit-to-democratizing-generative-ai-with-a-strengthened-collaboration/ https://aws.amazon.com/blogs/machine-learning/aws-and-mistra...

mips_avatar 1y ago
I don't know what democratizing AI means, AWS doesn't have the GPU infrastructure to host inference or training on a large scale.
- PartiallyTyped 1y ago
  Huh? That’s quite the assertion. They provide the infrastructure for Anthropic, so if that’s not large scale idk what is.
  - ZeroCool2u 1y ago
    They have to use GCP as well, which is arguably a strong indictment of their experience with AWS. Coincidentally, this aligns with my experience trying to train on AWS.
- lizknope 1y ago
  I started this part of the thread and mentioned Trainium but the person you replied to gave a link. Follow that and you can see Amazon's chips that they designed. Amazon wants people to move away from Nvidia GPUs and to their own custom chips. https://aws.amazon.com/ai/machine-learning/inferentia/ https://aws.amazon.com/ai/machine-learning/inferentia/ https://aws.amazon.com/ai/machine-learning/trainium/ https://aws.amazon.com/ai/machine-learning/trainium/
  - mips_avatar 1y ago
    TBH I was just going off of that I've heard AWS is a terrible place to get h100 clusters at scale. And for the training I was looking at we didn't really want to consider going off CUDA.
JCM9 1y ago
It’s unclear why Swami is put in charge of this stuff. He’s not a recognized leader in the space and hasn’t delivered a coherent strategy. However, per the article Amazon is struggling to hire and retain the best talent and thus it may just be the best they have.
- code4tee 1y ago
  Who is “Swami?” Although I suppose that’s just making the point that Amazon’s folks aren’t recognized leaders in this space.

mips_avatar 1y ago

I don't know what democratizing AI means, AWS doesn't have the GPU infrastructure to host inference or training on a large scale.

PartiallyTyped 1y ago
Huh? That’s quite the assertion. They provide the infrastructure for Anthropic, so if that’s not large scale idk what is.
- ZeroCool2u 1y ago
  They have to use GCP as well, which is arguably a strong indictment of their experience with AWS. Coincidentally, this aligns with my experience trying to train on AWS.
lizknope 1y ago
I started this part of the thread and mentioned Trainium but the person you replied to gave a link. Follow that and you can see Amazon's chips that they designed. Amazon wants people to move away from Nvidia GPUs and to their own custom chips. https://aws.amazon.com/ai/machine-learning/inferentia/ https://aws.amazon.com/ai/machine-learning/inferentia/ https://aws.amazon.com/ai/machine-learning/trainium/ https://aws.amazon.com/ai/machine-learning/trainium/
- mips_avatar 1y ago
  TBH I was just going off of that I've heard AWS is a terrible place to get h100 clusters at scale. And for the training I was looking at we didn't really want to consider going off CUDA.

JCM9 1y ago

It’s unclear why Swami is put in charge of this stuff. He’s not a recognized leader in the space and hasn’t delivered a coherent strategy. However, per the article Amazon is struggling to hire and retain the best talent and thus it may just be the best they have.

code4tee 1y ago
Who is “Swami?” Although I suppose that’s just making the point that Amazon’s folks aren’t recognized leaders in this space.