4 ms·

Cloudflare recently announced that they would be building out some data centers with EPYC CPUs. Do you believe that the situation has changed since February? Th

Cloudflare recently announced that they would be building out some data centers with EPYC CPUs. Do you believe that the situation has changed since February? They did a pretty exhaustive analysis [0] of price, performance, and power where they saw an advantage in switching away from Intel for that generation at least. If the existing server hardware is already in a decent spot, then maybe they need to spend more resources on sales rather than making changes to keep it cutting edge. [0] https://blog.cloudflare.com/an-epyc-trip-to-rome-amd-is-cloudflares-10th-generation-edge-server-cpu/ https://blog.cloudflare.com/an-epyc-trip-to-rome-amd-is-clou...

wahern 6y ago
I think Cloudflare is a different kind of "edge" service than what EPYC Embedded targets, and I would think Cloudflare uses regular EPYC chips. The "edge" that EPYC Embedded, Xeon D, etc target is, I think, more about the hardware configurations (smaller enclosures, minimal number of drives and other devices) and the type of facility (usually not a colocation facility, so power and heat are of significantly more concern). But the workloads are still very much server-class. EPYC Embedded chips are competitive with Intel's offerings (Xeon D, etc), but as I said Intel's ecosystem is richer--for example, more, better motherboards. It's not enough that AMD's chips are competitive with Intel's. AMD has a huge ecosystem handicap, and so either they need to improve the ecosystem or sell chips that are dramatically better than Intel's, and for EPYC Embedded neither is the case. Long term a better ecosystem is necessary for AMD to survive because a broader product and customer base brings consistent income and mindshare--staying power. I would hope and assume AMD is working closely with cloud vendors on their proprietary hardware, but the results are opaque; judging by traditional channels (Supermicro, etc), AMD hasn't even begun to close the gap.
- pdpi 6y ago
  I don’t think survival is at stake. AMD powers both XBox and PlayStation for the second generation in a row and that ought to help keeping them alive. It’s more a matter of whether they can capture enough of the market so they’re not merely “surviving”.
  - wahern 6y ago
    Fair enough. Survive was a poor choice. What I had in mind was surviving as a contender at the high-end, so we can continue to benefit from competition for server-class chips. Alpha, SPARC, and POWER all lost the high-end market (their only market) to Intel at a time when Intel was inferior. AMD previously failed because Intel surpassed them, but that's because AMD couldn't leverage their initial advantage to secure their markets and thus their ability to keep investing. Without volume and mindshare failure is inevitable. Providing the best high-end chips is insufficient to remain competitive long-term. The reasons for previous failures were complex (ISA, operating system, sales channels, etc), but ultimately it comes down to something like diversity--customer and product diversity provide buffers in terms of sales as well as changes in market direction. AMD's chips are indisputably better than Intel's right now, but even with Intel's mindboggingly massive fumbles they're barely sweating in terms of current and prospective revenue.
    - galaxyLogic 6y ago
      > Providing the best high-end chips is insufficient to remain competitive long-term Reason Alpha SPARC and POWER failed was they did not support the de facto standard X86 instruction-set, I believe. So the fastest most power efficient chip is not enough unless it can also run the most common software
      - minot 6y ago
        > most common software Maybe it is different this time because well for one Intel and AMD are on the same architecture but more importantly for arm or other platform, maybe this time is different because the servers mostly run on open source software. Given the potential revenue, I'd imagine it should be pretty straightforward to port common server software to any architecture if it isn't already?
      - HelloNurse 6y ago
        In this case "most common software" meant proprietary and nonportable operating systems and applications. Would you buy a server that will run the software you want to use either never (Windows and Windows applications developed on Windows) or maybe, eventually, as long as the new platform is a success (only slightly more portable proprietary Unix variants)?
MikusR 6y ago
And before that Cloudfare announced that they are migrating to Arm servers.
- no_wizard 6y ago
  Turns out it just wasn't performant enough for their applications, per this follow up post: https://blog.cloudflare.com/technical-details-of-why-cloudflare-chose-amd-epyc-for-gen-x-servers/ https://blog.cloudflare.com/technical-details-of-why-cloudfl... ARM just needs to be a little bit more competitive on performance per watt and a few other metrics...I think when Apple inevitably either proves ARM can be a very powerful platform via their migration to complete ARM based computing, we'll see a lot more movement and investment here, I'd say ~5 years is a good timeframe to start seeing serious long term shifts to ARM. If Apple fails to do this within that time frame, I think that may push it out longer. They're already pushing the limits of ARM as a platform with their custom chipsets I think nvidia's long term strategy is going to be built around this, among other things, otherwise I believe they overpaid for ARM holdings. They'll need to make sure they can expand the market for ARM CPUs to drive ever more GPU sales in the future. They haven't been as successful getting their embedded GPUs into the ARM market if I recall correctly

wahern 6y ago

I think Cloudflare is a different kind of "edge" service than what EPYC Embedded targets, and I would think Cloudflare uses regular EPYC chips. The "edge" that EPYC Embedded, Xeon D, etc target is, I think, more about the hardware configurations (smaller enclosures, minimal number of drives and other devices) and the type of facility (usually not a colocation facility, so power and heat are of significantly more concern). But the workloads are still very much server-class. EPYC Embedded chips are competitive with Intel's offerings (Xeon D, etc), but as I said Intel's ecosystem is richer--for example, more, better motherboards. It's not enough that AMD's chips are competitive with Intel's. AMD has a huge ecosystem handicap, and so either they need to improve the ecosystem or sell chips that are dramatically better than Intel's, and for EPYC Embedded neither is the case. Long term a better ecosystem is necessary for AMD to survive because a broader product and customer base brings consistent income and mindshare--staying power. I would hope and assume AMD is working closely with cloud vendors on their proprietary hardware, but the results are opaque; judging by traditional channels (Supermicro, etc), AMD hasn't even begun to close the gap.

pdpi 6y ago
I don’t think survival is at stake. AMD powers both XBox and PlayStation for the second generation in a row and that ought to help keeping them alive. It’s more a matter of whether they can capture enough of the market so they’re not merely “surviving”.
- wahern 6y ago
  Fair enough. Survive was a poor choice. What I had in mind was surviving as a contender at the high-end, so we can continue to benefit from competition for server-class chips. Alpha, SPARC, and POWER all lost the high-end market (their only market) to Intel at a time when Intel was inferior. AMD previously failed because Intel surpassed them, but that's because AMD couldn't leverage their initial advantage to secure their markets and thus their ability to keep investing. Without volume and mindshare failure is inevitable. Providing the best high-end chips is insufficient to remain competitive long-term. The reasons for previous failures were complex (ISA, operating system, sales channels, etc), but ultimately it comes down to something like diversity--customer and product diversity provide buffers in terms of sales as well as changes in market direction. AMD's chips are indisputably better than Intel's right now, but even with Intel's mindboggingly massive fumbles they're barely sweating in terms of current and prospective revenue.
  - galaxyLogic 6y ago
    > Providing the best high-end chips is insufficient to remain competitive long-term Reason Alpha SPARC and POWER failed was they did not support the de facto standard X86 instruction-set, I believe. So the fastest most power efficient chip is not enough unless it can also run the most common software
    - minot 6y ago
      > most common software Maybe it is different this time because well for one Intel and AMD are on the same architecture but more importantly for arm or other platform, maybe this time is different because the servers mostly run on open source software. Given the potential revenue, I'd imagine it should be pretty straightforward to port common server software to any architecture if it isn't already?
    - HelloNurse 6y ago
      In this case "most common software" meant proprietary and nonportable operating systems and applications. Would you buy a server that will run the software you want to use either never (Windows and Windows applications developed on Windows) or maybe, eventually, as long as the new platform is a success (only slightly more portable proprietary Unix variants)?

MikusR 6y ago

And before that Cloudfare announced that they are migrating to Arm servers.

no_wizard 6y ago
Turns out it just wasn't performant enough for their applications, per this follow up post: https://blog.cloudflare.com/technical-details-of-why-cloudflare-chose-amd-epyc-for-gen-x-servers/ https://blog.cloudflare.com/technical-details-of-why-cloudfl... ARM just needs to be a little bit more competitive on performance per watt and a few other metrics...I think when Apple inevitably either proves ARM can be a very powerful platform via their migration to complete ARM based computing, we'll see a lot more movement and investment here, I'd say ~5 years is a good timeframe to start seeing serious long term shifts to ARM. If Apple fails to do this within that time frame, I think that may push it out longer. They're already pushing the limits of ARM as a platform with their custom chipsets I think nvidia's long term strategy is going to be built around this, among other things, otherwise I believe they overpaid for ARM holdings. They'll need to make sure they can expand the market for ARM CPUs to drive ever more GPU sales in the future. They haven't been as successful getting their embedded GPUs into the ARM market if I recall correctly