7 ms·
My concern about this is that with the failure of Qualcomm Centriq, there is no industry standard/affordable/easy to buy ARM based server platform ordinary pers
by walrus01 7y ago
My concern about this is that with the failure of Qualcomm Centriq, there is no industry standard/affordable/easy to buy ARM based server platform ordinary persons and small/medium sized businesses can acquire.
It's great that Amazon has ARM based stuff, but it's something proprietary they're purchasing in large quantities from a manufacturer they have a very close relationship with. Undoubtedly the physical hypervisor platform and motherboard these things are running on is something totally bespoke and designed to Amazon's unique requirements.
I can't pull out my visa card and go buy a (atx, microatx, mini-itx) format motherboard for an ARM CPU, the CPU itself, RAM, etc, and build a system to run debian, centos, RHEL, ubuntu whatever on.
This means that, sure, you can get an EC2 ARM based server, but it's something you can't physically own and you'll be paying cloud based service rates forever if you want to keep running it. There are some categories of business and government entities where not having things on-premises, or fully owning and controlling the hypervisor all the way down to the bare metal, is a non starter.
If the ARM platform Amazon is buying becomes truly price/performance competitive with a single/dual socket xeon or threadripper/epyc, it also gives a possible competitive advantage to Amazon over any medium-sized cloud based VM provider out there currently selling (xen, kvm) based VMs on x86-64 hypervisors.
Based on what's available on the market right now I see no signs of there being a viable hardware-purchasing alternative to Intel or AMD based motherboards and CPUs.
- rjsw 7y agoFor AArch64, there is this [1]. [1] https://www.solid-run.com/nxp-lx2160a-family/honeycomb-workstation/ https://www.solid-run.com/nxp-lx2160a-family/honeycomb-works...
- walrus01 7y agoThat thing is $750 and probably performs much worse than a two year old Ryzen 1500X ($159 at the time) on a $105 motherboard. Nevermind a new Ryzen 3500 which is $194.
- sudosysgen 7y agoAnd probably close to an order of magnitude worse.
- WanderPanda 7y agoWhat about single board computers?
- bhouston 7y agoI think there is bias against them because they are so cheap. But they are arm64 and with 4 or 6 cores now. Still slow compared to an Intel/amd desktop but just always ssh/sshfs into them from your primary machine. I do this with vscode and it is great. Even better if you primary machine is Linux based.
- rjsw 7y agoThe main problem that I find with current SBCs is their limited DRAM. Trying to compile stuff I can't keep all cores busy.
- deleted 7y ago[deleted]
- vorpalhex 7y agoThey lack some important things you need in a datacenter like hardware management platforms. You also can't upgrade components or add interfaces (which at their cost point makes some sense). SBCs have generally been hobbyist oriented. It would be interesting to see some be datacenter oriented.
- colechristensen 7y agoDid some poking around, supermicro found nothing. CDW and NewEgg show no results. Gigabyte has a handful of systems. https://www.gigabyte.com/ARM-Server https://www.gigabyte.com/ARM-Server https://www.officedepot.com/a/products/6889935/Gigabyte-R120-T32-Barebone-System-1U/ https://www.officedepot.com/a/products/6889935/Gigabyte-R120...
- bhouston 7y agoRockpi, raspberry pi, orange pi all have 4 or 6 core arm64 sbc.
- berbec 7y ago$20 gets you quad-core headless https://www.friendlyarm.com/index.php?route=product/product&product_id=180 https://www.friendlyarm.com/index.php?route=product/product&...
- LargoLasskhyfv 7y agolscpu from that thing: Architecture: aarch64 Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 NUMA node(s): 1 Vendor ID: ARM Model: 4 Model name: Cortex-A53 Stepping: r0p4 CPU max MHz: 1296.0000 CPU min MHz: 120.0000 BogoMIPS: 48.00 NUMA node0 CPU(s): 0-3
- walrus01 7y agoFor comparison a raspberry pi4 is nominally 270 bogomips
- mastre_ 7y agoAs another data point, an rpi 3B+ 1.3 is only 38.40 BogoMIPS as reported by lscpu: pi@raspberrypi:~ $ lscpu Architecture: armv7l Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 Vendor ID: ARM Model: 4 Model name: Cortex-A53 Stepping: r0p4 CPU max MHz: 1400.0000 CPU min MHz: 600.0000 BogoMIPS: 38.40 Flags: half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt vfpd32 lpae evtstrm crc32
- derefr 7y ago> I can't pull out my visa card and go buy a (atx, microatx, mini-itx) format motherboard for an ARM CPU, the CPU itself, RAM, etc, and build a system to run debian, centos, RHEL, ubuntu whatever on. The difference between ARM and x86 is that there's no standardized ARM interface between the motherboard and the CPU—no ARM equivalent to ACPI. Every integration of an ARM CPU into a board is bespoke. So you have to buy "a board with an ARM CPU on it", not just an ARM CPU and board separately. But, if you relax that restriction, it's not like it's hard to acquire "a board with an ARM CPU on it." 80% of single-board computers (e.g. the Raspberry Pi) are "a board with an ARM CPU on it." You can wipe pretty much any Android device (not just phones, but also HDMI "streaming boxes", which are a convenient form-factor for basing a workstation on) and install Linux on them. There are also some higher-end development/SDK boards for ARM embedded systems, like the Nvidia Jetson. What more do you need?
- walrus01 7y agoMy first question would be, why has no industry trade group attempted to define a standard socket, or use an existing physical socket pin-out. It's not hard to acquire something with an ARM CPU on it, but at prices an ordinary person can afford, they're all in the category of toy computers. Try to find an affordable ARM system with a M.2 2280 NVME SSD slot on it like you can find on a $100 desktop x86-64 motherboard. Or multiple PCI-Express 3.0 x8/x16 slots. I've previously spent many years working for a hardware manufacturer. Personal theory is that this is a real example of a chicken or egg problem related to economies of scale. Nobody wants to spend dozens of millions of dollars tooling up to produce ARM socketed CPUs and motherboards and stuff, which may or may not be price/performance competitive with current-gen Intel and AMD stuff by the time it's ready for release. And there's a huge risk in manufacturing something like that and then discovering that the sales volumes are really low. Look at the sheer massive quantities that the top-ten Taiwanese motherboard manufacturers churn out every year. > You can wipe pretty much any Android device (not just phones, but also HDMI "streaming boxes", which are a convenient form-factor for basing a workstation on) and install Linux on them No you really can't, and phones aren't servers. Take any modern $600 smartphone and try installing something very close to a stock debian or centos on it. Being able to maybe boot a Linux kernel on something doesn't mean that there's anything like the market demand for that particular hardware platform target for a whole distribution.
- moyix 7y agoIt's perfectly possible to buy an ARM server. We recently got a ThunderX2-based server from Phoenics: https://www.phoenicselectronics.com/catalogsearch/result/?q=thunderx2&x=0&y=0 https://www.phoenicselectronics.com/catalogsearch/result/?q=...
- giancarlostoro 7y ago> I can't pull out my visa card and go buy a (atx, microatx, mini-itx) format motherboard for an ARM CPU, the CPU itself, RAM, etc, and build a system to run debian, centos, RHEL, ubuntu whatever on. You can buy a SBC though, so you don't necessarily need to. There's SBC's with more power than the Raspberry Pi (at least up to 3). They just cost more. I'm starting to get into the habit of using more Raspberry Pi's at home for network stuff, and I'm debating setting one up for a web development target platform, something that can be code-pen like but on my Pi. Beats running a bunch of VMs and cheaper than buying a whole rig just for VMs.
- floatboth 7y agoIf your credit card is massive: https://store.avantek.co.uk/arm-servers.html https://store.avantek.co.uk/arm-servers.html — both Ampere and Marvell (Cavium) are available. As a normal person, you're mostly stuck with SolidRun's offerings if you want something that's affordable but serious (i.e. can run PCIe devices). I run a MACCHIATObin as a desktop with FreeBSD, it's fine, great open source UEFI-ACPI firmware (upstream EDK2), generic ECAM PCIe works (with a quirk but still), but it's not a powerful system. Four A72 cores, single DDR4 channel. It's basically a rather-old-ultrabook level of performance. Then there's their new thing with the NXP LX2160A 16-core dual-channel chip — there was a loooot of doubt about whether they could achieve good ACPI support on that SoC. But recently NXP have pushed a commit that introduces a generic description of the PCIe controller to the ACPI tables..
- rbanffy 7y agoInteresting. I wonder if there are any actual niches where these boxes offer a better cost/performance compared to a similar x86 server.
- NicoJuicy 7y agoOn black Friday, I bought a AMD 2600, 64 gb ram and 256 SSD + 6 TB 7200. And a 8 gb GPU. I paid 1000€, 140€ shipping Planning to do something similar for a 8 node rpi 4 cluster, depending the results ( 600€ because of PoE) I'm pretty sure I will come out insanely more cheaper to run my microservice experiments with docker then hosting it in the cloud. I don't care/talk about ARM currently. Where I work they will go for performance / € in the cloud. Not many people care about ARM in the cloud. I don't know why the topic of coming from. Or what I'm missing?
- imtringued 7y agoWhat made you skimp on the SSD? I bought a 512GB SSD for 66€ last year and now the newer equivalent model sells for 57€.
- kabdib 7y agoHmmm, at those prices I would worry about the quality of the SSD. (I've learned to trust a few brands, learned to avoid a few others, the hard way. The 512GB SSDs I'd consider purchasing go for 2X-4X your mentioned cost).
- ansible 7y agoIf you're feeling adventurous, you could try running bcache to speed up HDD access with the SSD. https://wiki.archlinux.org/index.php/Bcache https://wiki.archlinux.org/index.php/Bcache
- TheCondor 7y agoI agree, as someone that's had some "off mainstream" hardware over the years, I'd kind of like to have a 16+ core ARM server to play with; just because that's the kind of dork that I am. Really though, I think this is other things, if amazon can become independent from Intel and AMD? that gives them huge leverage in terms of negotiations with them. Really, it sets AWS up quite nicely for the time when they are broken up and split out.