9 ms·
“If this doesn’t work for IBM, if this doesn’t give Big Blue a chance to really capture a bigger slice of HPC and take some aggressive share in machine learning
by Annatar 9y ago
“If this doesn’t work for IBM, if this doesn’t give Big Blue a chance to really capture a bigger slice of HPC and take some aggressive share in machine learning and accelerated databases, it is hard to imagine what could.”
No it isn’t; why did all non-intel processors fade into obscurity and why does intel architecture with all of its Zilog 80 baggage dominate? Because one can’t get a dirt cheap (under $500) POWER9 desktop or server; same goes for MIPS, UltraSPARC, anything else that’s modern and non-intel... why is ARM so popular? Because one can buy it dirt chip for tinkering with it at home. That is what propelled ARM and intel, people would install a Linux ISO on their parents’ old
PC and it built up familiarity.
Until that happens with POWER (or any other non-ARM, non-intel architecture) history has taught me that it will fail. Hardware has to be easily accessble and dirt cheap, and things like software mirroring or compilers must come with the OS and all the software has to be gratis. Otherwise history says - fail! Sometimes of epic
proportions (hp, sgi, Sun, IBM).
Sun Microsystems for example eventually realized that the software has to be gratis and open source, but they lived in this fantasy world where they thought they could charge anything they wanted for hardware — and would indignantly argue about it when it was pointed out to them that it’s way too overpriced and expensive. That lost them familiarity with the hardware and familiarity with the OS because for most people a second hand used PC-bucket with GNU/Linux was good enough and the target audience wouldn’t have known or cared about all the advanced features anyway. We all know how that ended.
- ser9 9y agoBut the reason that intel is and has been cheap is the scale that their monopoly on the desktop has created. This position has given them a opportunity to develop fabs for node sizes that is out of reach for any competitor while keeping a competitive price point. At the moment it seems like Moores law is slowing down, and ARM on mobile has given scale to independent fabs to catch up with intel. So the situation may actually be a bit different this time.
- _ph_ 9y agoIt isn't about the cost of the cpu. Yes Intel eventually won on the market scale. But the real problem was, that you couldn't get a Sparc or PowerPc or whatever on a standard PC motherboard for a reasonable price. From the middle to end of the 90ies, lots of the Linux community would gladly have bought a non-x86 CPU/motherboard combo. The RISC-processors of that time still had an edge over Intel. Even later, with the G5 processor, they could have been competetive, if there had been a CPU/motherboard combo available.
- Annatar 9y agoExactly this! Linus himself wrote that the only reason Linux exists is because a Sun workstation was too expensive.
- orionblastar 9y agoYou do understand that this is server not PC tech? The mainframes and minicomputer that service hundreds of users at once? You remember the old client server model? IBM System/370 IBM AS/400 etc before they became System Z etc?
- krylon 9y agoBut the machine shown here is not a mainframe nor a AS/400 or successor. It does not run AIX, OS/400 (pardon me: IBM i) or any of their mainframe OSes. It runs Linux. And while I am sure it is a sweet machine that offers great performance and reliability, it is rather expensive. If you want to - especially if you mostly care about the GPU part anyway - you can get an Intel or AMD based machine for a fraction of the price. IBM still stells the large POWER servers that run AIX or IBM i (in addition to Linux), and they still make their zSeries mainframes. But at least the latter are even more expensive. All of these are really great machines; IBM has decades of experience building computers for some fairly demanding customers, and from what I know about these machines, it shows. But do not confuse the machine described in the article with IBM's top-shelf machines.
- Annatar 9y agoAs someone who literally grew up on HPC (sgi Origin 2000 and 3800’s to be precise), yes, I completely understand.
- sliken 9y agoDunno, not sure I buy it. From a software devel point of view it's "just" linux. The full ecosystem is there, clang/gcc, ruby, perl, python, javascript, apache, mysql, nginx, postgres, etc. About the only thing I can think of that might be different is if you are using cycle counters for profiling things, but it's rare to need to get to that level these days. I think the real problem is everyone likes to target the top of the Intel systems that sell in very low quantities. Sure I'm sure HFT folks can make huge $$$ trading just a bit faster. But the bulk of Intel server sales are the low/mid range. Things like the E5-2620/E5-2630 that costs $300-$500 per CPU and has nice capable servers starting around $2k. Sure $65k power system with 4 Voltas sounds great. But few will drop over $50k on a server without having a few cheaper servers in production for awhile. Beating the collective performance of 10 $5k servers is also going to be tough. Amusingly Intel fails that same test, rarely are the top chips the best price/performance unless the cheaper servers trigger needing to buy a new building. Not to mention if IBM starts getting traction you can bet those $5k per CPU intel chips will start getting discounts rather quickly.
- klodolph 9y agoThere’s a certain amount of laziness that prompts people to get bigger servers. I’ve been at a few companies where the solution to performance issues (as in, the thing that makes us money isn’t keeping up with customers and therefore we can’t grow our business) is to make the server bigger. Switching to a distributed system is sometimes too far off the radar and costs precious engineering time. So the story is “just buy a bigger and faster computer, we’ll figure out how to shard this later.” The company drops more cash on IBM or whatever, and the engineers focus on features that close sales deals. And then there are the larger companies which buy some expensive IBM servers and port their software in order to squeeze discounts out of Intel.
- mseebach 9y agoIt's a difficult balance to get right. A $2k server as the GP describes costs less than a week of a fully loaded engineer. If those $2k buys you another X time (for any X >> week) of the application working, then it's not at all obvious that it's the lazy or otherwise wrong step to take. (Lots of handwaving in the above, main takeaway is that it's the expected and rational path in a world where engineers are expensive and scarce and servers are cheap)
- nigwil_ 9y agoI agree with your points [2][3]. Why is this so hard for vendors to understand? It is an old idea called "mind share" [1] or in this case technical-mind-share, a vendor should want the largest possible community of technical people interacting with their technology and attempting to use it in as many niches as possible. I'm not sure it even has to be uniformly cheap, as long as there is a low-cost entry point to hook people. If the price ratchets up from that low entry point but it is a compelling solution people will want it in their technical lives and get it funded somehow. [1] https://en.wikipedia.org/wiki/Mind_share https://en.wikipedia.org/wiki/Mind_share [2] I would point to RISC-V as another example of a newly popular machine architecture due to its initial low-cost. [3] noting the preferenced technology must meet the minimal acceptable threshold for all the usual dimensions.
- Asooka 9y agoAs a corollary: see Microsoft, Adobe, etc. turning a blind eye to casual home users pirating their software. IIRC Microsoft even offered a free upgrade from pirated Windows 7 to a legit Windows 10 Home.
- Paianni 9y agoActually it is possible to get cheap MIPS stuff, not only in anonymous Android devices but also (m)atx boards Lemote produce for the CCP (for obvious reasons).
- walterbell 9y agoCan they be purchased in US or Europe?
- rwmj 9y agoSure: https://rwmj.wordpress.com/2015/04/29/mips-creator-32-bit-dual-core-mips/ https://rwmj.wordpress.com/2015/04/29/mips-creator-32-bit-du... They have abysmal performance however. An RPi 3 (or just about any 64 bit ARM board) will perform better and cost less.
- Annatar 9y agoDesktop is what buys mindshare. A Raspberry Pi is an embedded device, a desktop and a very entry level server all in one and exactly that is the appeal. Where can one buy a dirt cheap, modern MIPS 1U server or a desktop today?
- reacharavindh 9y agoYes, as an HPC admin, let me foretell how it will go here at our research group. Me: Oh look this is fascinating! We have a worthy competitor to intel processors and we can do our work way faster. Let's get this! Boss: Ok, tell me why one of this costs more than all of our other servers put together? Me: But, it is so much better, it does blah, blah and more blah. Boss: Do we really need it? What would we save by getting this instead of the commodity servers we normally buy. May be we should look into making our code work better with GPUs instead? Me: .......... Don't get me wrong. I think this really is fascinating. Just for the HFT traders and the top 1% buyers of exotic hardware. Not to an average HPC shop like ours, until the economy of scale and premium catches up to value.
- phkahler 9y ago>> Not to an average HPC shop like ours... And there lies the problem. HPC used to be a tiny market with huge budgets where expensive hardware was the norm. It's just not that big a deal any more. It's commodity hardware now with lots of cores and GPUs running OSS. They won't make it trying to charge a premium just because it's Power9.
- onikolas 9y agoI wonder if Moore's law was the real reason why all the RISC vendors failed while Intel succeeded. Lets say IBM sells server hardware for 60K USD per machine versus Intel's 20k (I made the numbers up) and shows, through extensive benchmarking, that despite the higher initial cost, their machine's performance/dollar is better than Intel. Then 2 years later Moore's law happens. Intel's new 20k offering now outperforms IBM's old machine on every metric. In hindsight, IBM didn't make sense financially. With Moore's law slowing down, maybe now its the right time for IBM to make a move.
- klodolph 9y agoIntel chips are more RISC-like on the “inside” after the instructions are decoded, and in that sense RISC is successful. ARM is RISC and very successful. But most RISC and CISC vendors alike are failures by comparison to Intel and ARM, and the IBM Power processors are just not that performant per watt. You don’t even have to wait 2 years, they’re already not as good. Part of this may be due to Intel’s lead in manufacturing technology, and have nothing to do with architecture. (Historically, RISC was much more competitive. Talking about current state of affairs.)
- userbinator 9y agoARM is RISC and very successful. Actually, ARM is more CISC-y than MIPS, POWER, SPARC, etc. and recent cores break more complex instructions into uops just like x86. If you consider uops RISC, then just about every architecture is "RISC-like on the inside". RISC is about a simple and restrictive user-facing ISA, not the internal microarchitecture. In the long term, CISC makes a lot of sense --- it saves on fetch bandwidth and instruction cache to essentially have the CPU "decompress" complex instructions to execute internally, and the core is many times faster than memory. IMHO "pure RISC" was an academic exercise, and the only reason why early CISCs were easily beaten was because they were sequential/in-order, and memory bandwidth wasn't a bottleneck at the time. With the growing core speeds, memory becoming a bottleneck, and invention of parallel uop decoding/execution, CISC could do more per clock and with less instructions. You can see this trend here: https://en.wikipedia.org/wiki/Million_instructions_per_second#Timeline_of_instructions_per_second https://en.wikipedia.org/wiki/Million_instructions_per_secon... The best ARM core on that list can do 3.5 DMIPS/MHz, and the best MIPS at 2.3 DMIPS/MHz, while the best x86 core is at >10 DMIPS/MHz.
- rbanffy 9y ago> Zilog 80 baggage 8080, please. The 8086 was designed to be assembly-level source compatible with 8080's so porting software (here's to you, Gary) from CP/M would be easy.
- wolfgke 9y ago> 8080, please. The 8086 was designed to be assembly-level source compatible with 8080's so porting software (here's to you, Gary) from CP/M would be easy. 1. The 8086 was not designed to be assembly-level source compatible, but nevertheless intended that assembly code from 8080 could easily be ported to 8086 (mostly find & replace) 2. Zilog developed a different assembly language for the Z80 than Intel used for the 8080 (for copyright reasons, I think - though nearly everybody would agree that Zilog's assembly syntax is better; compare for yourself: http://nemesis.lonestar.org/computers/tandy/software/apps/m4/qd/opcodes.html http://nemesis.lonestar.org/computers/tandy/software/apps/m4... ). The Z80 assembly language was a strong inspiration for the x86 (8086) assembly language (Intel syntax). 3. The Z80 introduced two index registers (IX, IY) over the 8080. A strange coincidence that Intel also did introduce two index registers for the 8086 (si, di). 4. Do the INI/INIR/IND/INDR/OUTI/OUTIR/OUTD/OUTDR that were introduced by Zilog for the Z80 strongly remind you of the INS/REP INS/OUTS/REP OUTS (just consider that the 8086 uses the direction flag) instructions of the 8086? etc. TLDR: Intel took more "inspiration" from the Z80 than is generally acknowledged.
- Annatar 9y agoThe 8080 and 8086 designs draw directly from Z80. You can see it in the assembler mnemonics and how the operands are handled. And segmented memory access, oh my!
- swiley 9y agoYou can definitely get cheap MIPS machines, I have a MIPS board in my robot that only costs $5 in bulk.
- Hazematman 9y agoDo you have a link to which MIPS machine it is?
- coderjames 9y agoNot the OP, but here are a few MIPS boards I'm familiar with in the under-$100 range. Microchip makes a couple low-end MIPS boards: http://www.microchipdirect.com/product/search/all/DM320103 http://www.microchipdirect.com/product/search/all/DM320103 http://www.microchipdirect.com/product/search/all/DM320004-2 http://www.microchipdirect.com/product/search/all/DM320004-2 When you outgrow those, you can move up to the Creator Ci20 from Imagination: https://www.mouser.com/search/ProductDetail.aspx?R=0virtualkey0virtualkeyVL-62851 https://www.mouser.com/search/ProductDetail.aspx?R=0virtualk...
- baldfat 9y agoARM is the future. Example Apple's A11. For single thread ((which is what's most important on 90% of today's use cases) side note can this stop being true by 2020?) can compete with single threaded processes. Apple's A11 (single thread) 4217 (multi) 10164 https://browser.geekbench.com/ios-benchmarks https://browser.geekbench.com/ios-benchmarks Intel i7 8700k (single thread) 6089 (multi) 26654 https://browser.geekbench.com/processor-benchmarks https://browser.geekbench.com/processor-benchmarks It appears that we are near the end of physically making smaller nano meters and we are back to the co-processors (Like the old Amiga days) Co-Processors and some kind of Assembly (A Lisp that complies to an ARM Assembly to much for one to ask for???) are going to be the way we improve speed in the future.
- qubex 9y agoCoincidentally (as no doubt you are aware) yesterday Microsoft released Windows 10 for ARM devices with built-in emulation, and a couple of hardware partners launched suitable systems based on SnapDragon 835 SoC. The future is arriving very fast.
- baldfat 9y agoSoftbank's purchase of ARM is looking like a genius move even more now.
- qubex 9y agoYeah, but beyond that, I'm still of the generation (born 1981) that grew up hearing about amazing IBM RISC RS/6000 workstations, and so I'm still inexplicably drawn to any mention of this kind of technology as a “shiny thing”. I know it's mundane and broadly available in the lowest common-denominator hardware but it still attracts me like a moth to a flame. I know I'm a sucker.
- snvzz 9y agoARM is the past, as pretty much every prominent chipmaker currently using ARM is in the RISC-V consortium today, and will be selling chips based on RISC-V tomorrow.
- ams6110 9y agoM68K and PowerPC architectures died out, and were available in consumer systems (Macintosh) and while not "dirt" cheap still in the ballpark of affordable. And you could find old cheap ones and run linux on them too. The real reason Intel/AMD64 is popular is the same reason Windows is popular -- mindshare and economies of scale. IBM and the x86 platform won the business desktop in the 1980s and that has been propelling everything on that architecture ever since.
- deaddodo 9y ago> why does intel architecture with all of its Zilog 80 baggage dominate The Z80 was a clone of the 8080, not the other way around.