3 ms·
Mid priced xeons: all sorts of motherboards available from eight different Taiwan based OEMs. AMD: I need some threadripper or server Zen motherboards, again t
by walrus01 9y ago
Mid priced xeons: all sorts of motherboards available from eight different Taiwan based OEMs.
AMD: I need some threadripper or server Zen motherboards, again there's 4+ OEMs with many designs.
Both amd and Intel: all sorts of stuff available that meets open compute platform dimensions for motherboards. Or for ordinary 1U servers, or atx size boards that can be mounted in DIY blade enclosures.
ARM: where are the motherboards I can buy right now in small to low quantities, and what are their specs/price? Who makes them? It I want to order 40 or 400 tomorrow... where do I go?
Edit: I just spent ten minutes googling for arm centriq platform motherboards and cannot find a single product I can actually buy. As compared to how easily I could start the process of ordering a hundred 1U xeon based servers in the next half hour.
At a massive scale such as cloudflare, sure you can afford to custom order thousands of motherboards. But for a lot of operators who are not nearly as big as them, the existing economies of scale in the x86-64 platform are a greater advantage. Right now I'd be willing to bet that dual socket current generation xeon motherboards are manufactured in much greater numbers, as much as a ratio of 500:1, compared to ARM server motherboards. Being able to mix and match whitebox parts from Taiwan and China sources to DIY bare metal blade hypervisors is a huge advantage.
- Aissen 9y agoAll true. This is temporary, when(if?) this gets more traction, you'll find OEMs and distributors having what you want.
- walrus01 9y agoMany years ago there was an attempt to get third party manufacturers to start building motherboards for the IBM power4 architecture. Never came to fruition.
- yellowapple 9y agoThose attempts are still happening in this day and age of POWER8 and beyond.
- majewsky 9y agoAlso, when you can get your hands on a ARM motherboard, will you be able to boot mainline Linux or only some ancient kernel version that the vendor has patched with their own binary drivers?
- Aissen 9y agoMainline only. Also, it's supported in RHEL: https://www.redhat.com/en/blog/red-hat-introduces-arm-server-support-red-hat-enterprise-linux https://www.redhat.com/en/blog/red-hat-introduces-arm-server...
- imtringued 9y agoServers don't need a Mali GPU which is the major bottleneck to support mainline linux. I'm constantly amazed by people wanting to see Intel die for a minor price decrease. The open source drivers for intel gpus might have not been provided by intel but at the very least they exist. The same cannot be said by ARM. When it comes to proprietary software ARM is at least as evil as intel. By replacing intel with ARM you're going from bad to worse.
- walrus01 9y agoAgreed, and Intel actually had a track record of really good open source driver support for important stuff that is not GPU. Example, 11+ years ago when a single 10 gigabit NIC cost $6000, Intel had their own staff write and submit freebsd and Linux kernel drivers for their first gen card. The same has continued up until now if you look at the Linux kernel commits for Intel network interfaces.
- bjackman 9y agoI suppose this reality is the reason why ops like Cloudflare make a song and dance about it instead of just quietly putting QC chips in their datacentre: they want the market to flourish so that commodity parts become available, software ecosystem grows, and they start getting the benefits of competition amongst their suppliers.
- walrus01 9y agoIt is sort of a chicken or egg problem because nobody wants to be the first one to order 5000 bespoke motherboards that might have weird QC and BIOS/firmware issues.