4 ms·

Here are 2 things I have noticed that seem obvious weaknesses: 1. Looking at the CyberMonday and BlackFriday deals, I see that the 12900K and 14900* series CPU

Here are 2 things I have noticed that seem obvious weaknesses: 1. Looking at the CyberMonday and BlackFriday deals, I see that the 12900K and 14900* series CPUs are what is being offered on the Intel side. Meanwhile AMD has released newer chips. So Intel has issues with either yield, pricing or other barriers to adoption of their latest. 2. The ARC GPUs are way behind; it seems obvious to me that a way to increase usage and sales is to simply add more VRAM to the GPUs - Nvidia limits the 4090 to 24GB; so if Intel shipped a GPU with 48 or 64GB VRAM, more people would buy those just to have the extra VRAM. It would spur more development, more usage, more testing and ultimately result in ARC being a better choice for LLMs, image processing, etc.

hedora 2y ago
For that to work, they need a software stack to compete with CUDA. Nvidia is so far ahead that a single manufacturer won’t be able to compete for developers. Instead, the only chance the rest of the AI GPU market has is to build some portable open source thing and use it to gang up on Nvidia. That means bigger GPU players (AMD, hyperscalers) will need to be involved.
- Wytwwww 2y ago
  > For that to work, they need a software stack to compete with CUDA. Doesn't Intel have pretty decent support in PyTorch? It's not like most people working on/with AI use CUDA directly. And especially for stuff like LLMs software is hardly the main or even a significant barrier.
- shrubble 2y ago
  I am not a PyTorch user, but there is already Intel-supplied ARC acceleration for PyTorch: https://www.intel.com/content/www/us/en/developer/articles/technical/stable-diffusion-with-intel-arc-gpus.html https://www.intel.com/content/www/us/en/developer/articles/t... Having half the number of GPUs in a workstation/local server setup to have same amount of VRAM might make up for whatever slowdown there would be if you had to use less-optimized code. For instance running or training a model that required 192GB of VRAM would take 4x48GB VRAM but 8x24GB VRAM GPUs.
Wytwwww 2y ago
> pricing or other barriers to adoption of their latest. They are just not very good? There is basically no point in buying the current gen equivalent 14900K with current pricing (the only real advantage is lower power usage).
Sohcahtoa82 2y ago
> Meanwhile AMD has released newer chips. Your comment confuses me. BOTH have released newer chips. Intel with the Core Ultra 200 series and AMD with Ryzen 9000. Neither are going to be on Black Friday sales. > So Intel has issues with either yield, pricing or other barriers to adoption of their latest. How does not putting their latest chips on sale indicate trouble selling them?
dmead 2y ago
The 14900k is bugged. Don't buy it

hedora 2y ago

For that to work, they need a software stack to compete with CUDA. Nvidia is so far ahead that a single manufacturer won’t be able to compete for developers. Instead, the only chance the rest of the AI GPU market has is to build some portable open source thing and use it to gang up on Nvidia. That means bigger GPU players (AMD, hyperscalers) will need to be involved.

Wytwwww 2y ago
> For that to work, they need a software stack to compete with CUDA. Doesn't Intel have pretty decent support in PyTorch? It's not like most people working on/with AI use CUDA directly. And especially for stuff like LLMs software is hardly the main or even a significant barrier.
shrubble 2y ago
I am not a PyTorch user, but there is already Intel-supplied ARC acceleration for PyTorch: https://www.intel.com/content/www/us/en/developer/articles/technical/stable-diffusion-with-intel-arc-gpus.html https://www.intel.com/content/www/us/en/developer/articles/t... Having half the number of GPUs in a workstation/local server setup to have same amount of VRAM might make up for whatever slowdown there would be if you had to use less-optimized code. For instance running or training a model that required 192GB of VRAM would take 4x48GB VRAM but 8x24GB VRAM GPUs.

Wytwwww 2y ago

> pricing or other barriers to adoption of their latest. They are just not very good? There is basically no point in buying the current gen equivalent 14900K with current pricing (the only real advantage is lower power usage).

Sohcahtoa82 2y ago

> Meanwhile AMD has released newer chips. Your comment confuses me. BOTH have released newer chips. Intel with the Core Ultra 200 series and AMD with Ryzen 9000. Neither are going to be on Black Friday sales. > So Intel has issues with either yield, pricing or other barriers to adoption of their latest. How does not putting their latest chips on sale indicate trouble selling them?

dmead 2y ago

The 14900k is bugged. Don't buy it