3 ms·
IBM Announces the Z17 Mainframe Powered by Telum II Processors
- rbanffy 2y agoBased on the Telum II chip shown at last year's Hot Chips conference. https://chipsandcheese.com/p/telum-ii-at-hot-chips-2024-mainframe-with-a-unique-caching-strategy https://chipsandcheese.com/p/telum-ii-at-hot-chips-2024-main...
- theandrewbailey 2y ago> IBM’s solution is to reduce data duplication within its caches, and re-use the chip’s massive L2 capacity to create a virtual L3 cache. I was kind of fascinated with the original Telum CPUs because of this feature. Do we know if other CPU designers are planning a similar virtual cache feature? Or is this feature implemented as a workaround due to some other deficiency that others don't have?
- UltraSane 2y agoIt is needed for the Telum chips because they have so much L2 cache per core (36MB) there isn't room for any L3 cache
- rbanffy 2y agoThey could reduce core count to make space for on-chip L3, and add a massive amount of cache to the drawer controller, like the was on the z15, but this is way more efficient. They also keep the in-drawer and cross-socket latencies very low, forming a virtual L4 with all chips in the drawer. In the end, it's a more efficient way to allocate silicon.
- UltraSane 2y agoWould this architecture work on x86 or ARM CPUs? I'm surprised they didn't use HBM3 for CPU cache.
- CuriousRose 2y agoBeing 50% faster (article based guess-timate) what’s the average time that a mainframe stays in the fleet? Surely significant energy and data centre floor space savings might even capture some customers from the previous generation to upgrade? Or is it a 5-10 year cycle?
- vb-8448 2y agoIt depends on IBMs sales target. Some customer may change it even every 3-5 years, but most i saw were between 5 and 7. Energy and data centre floor space are not a real thing here, the mainframe usage of physical resource is nothing compared to other systems.
- trollbridge 2y agoMainframes are often leased, and with leasing charges based on how many CPU cores are used (regardless of how many are physically present).
- rbanffy 2y agoOne cool feature of the z16 was that all cores can be activated during startup, and then all cores that aren't licensed (paid for) shut down and the performance drops to the agreed limit. I do that with my KVM machines on the server under my desk - all are configured with more cores than needed and, when boot finishes, most cores are removed from process scheduling leaving just the amount the VM is supposed to use during normal operation. The result is a significantly faster start up and significantly lower power consumption (and resource contention).
- NitpickLawyer 2y agoIBM - mainframe - Zxx CPUs, what decade is this?!
- rbanffy 2y agoOne where no other company has pushed out a processor that can borrow cache from neighbors.
- deleted 2y ago[deleted]
- rubyfan 2y agoOne where legacy businesses still use the cobol programs developed in prior decades. I recently had to wait two quarters to launch a product because the only person who knew what some cobol accounting program did was out on leave. This is one of the many reasons many big corporations fail to innovate. It is very hard (near impossible) to implement new systems in an environment dominated by old ones (not talking only about software and hardware here, also organizational dynamics).
- Koshkin 2y agoI don’t think you necessarily need a mainframe in order to run a program written in COBOL. (There’s also emulation available, to accommodate worst case scenarios.)
- jabl 2y agoThere's even a COBOL frontend in GCC these days! That being said, the problem isn't so much the COBOL language itself but rather that all the software written in it is connected to all kinds of database system, messaging systems(?) and whatnot, making it very hard to move to some non-mainframe platform even if a customer so chooses. Or to put it another way, it's cheaper to pay even the very high prices to IBM to keep on the mainframe track rather than to migrate.
- 2y ago
- a012 2y agoIt’s funny that they managed to slap AI buzz into the mainframe
- myself248 2y agoIt's a real thing -- one of the oft-cited usage examples is running fraud detection while processing credit-card transactions. Customers want to add this powerful capability to that bedrock business process.
- gosub100 2y agoYou can detect fraud using non-AI solutions, but this way if it does something racist or shuts off an innocent person's access to money, they can shrug and blame it on the AI, then announce immediate "comprehensive measures" to prevent it in the future.
- xattt 2y agoWhat are the heuristics that AI models would use for a given transaction? Is it essentially just a “vibe check”?
- DougN7 2y agoI’ve been learning a bit about it after learning about RRCF (Robust Random Cut Forests). The ISOTree library is really well documented if you want to play with it.
- UltraSane 2y agocomplex Bayesian statistical models updated in real-time.
- spicybbq 2y agoThey use machine learning, pattern matching on what "good" and "bad" requests look like, based on experience.
- skyyler 2y agoAI feels really fuzzy compared to the types of work I normally associate with big iron.
- llm_nerd 2y agoFor those who wonder where this fits relative to platforms we are usually more accustomed to, they sell these to banks and financial services that have a long history of mainframes and are basically just upgrading in place within minimal change. With recent iterations they've added some AI processing on the silicon, offering baby steps to imbuing solutions like fraud detection with neural nets on chip. But to put it in context, the 24 TOPS that they advertise -- the inference performance of their AI module on their Telum II -- doesn't even match an M4's neural engine (40 TOPS). And of course compared to a dedicated device like an H100 SXM that can hit 4000 TOPS (yes, 166x more). Of course for both the M4 and H100 chip I'm giving quantized numbers, but presumably the Telum II is as it boasts about its quantized support. Massive caches. Tonnes of memory support. Neat device. A "you won't get fired for leasing this" solution for a few of the Fortune 500. But you can almost certainly build a magnitudes faster device in just about every dimension using more traditional hardware stacks and for a fraction of the price.
- claudex 2y agoIt's 24 TOPS per CPU, so 192 TOPS for a full mainframe. And you can add Spyre accelerator which have 32 AI unit per card (so 32x24 TOPS) and up to 48 cards per mainframe (so 48x32x24 = 36 864 TOPS). But yeah, you could buy a lot of H100 for the price of a mainframe with such a configuration.
- rswail 2y ago> But you can almost certainly build a magnitudes faster device in just about every dimension using more traditional hardware stacks and for a fraction of the price. Using the sentence "more traditional hardware stacks" when comparing to mainframes is sorta funny.
- UltraSane 2y agoIBM strictly forbids anyone from publishing performance benchmarks of their mainframes which should tell you that they are pretty slow for the money.
- hulitu 2y ago
- deleted 2y ago[deleted]
- memset 2y agoI interned at IBM writing mainframe software in 2008 or so. One thing I remember them saying - there used to be TV commercials - that a single mainframe could replace a rooms worth of commodity hardware. I would have assumed that someone would have started a cloud provider with Linux VMs running on mainframes instead of racks of pizza boxes. What was missing - are the economics of mainframes really that bad?
- ASalazarMX 2y agoMainframes are the polar opposite of commodity hardware. Those pizza boxes are commodity because they're plentifully available, and you can mix-and-match if needed, there's nothing cheaper for you to run your VMs on. Running them on a mainframe would put IBM as a middle man between you and your business. Also, mainframes/midranges are all about stability, security, and robustness, not performance. For example, IBM i (the OS, not the machine) has a hardware dependent layer, and a hardware-independent one. This allows for drastic hardware changes without affecting the high-level applications. A monolith would be arguably more efficient, but it matters more that the hardware-independent layer stays rock-solid. https://en.wikipedia.org/wiki/IBM_i#Architecture https://en.wikipedia.org/wiki/IBM_i#Architecture
- pabs3 2y agoIBM offer a cloud to open source folks already, not sure if they have a commercial one though. https://developer.ibm.com/articles/get-started-with-ibm-linuxone/ https://developer.ibm.com/articles/get-started-with-ibm-linu... https://wiki.debian.org/Hardware/Wanted#Other https://wiki.debian.org/Hardware/Wanted#Other
- sillywalk 2y agoA link to the IBM Redbook Technical Introduction [PDF]: https://www.redbooks.ibm.com/redbooks/pdfs/sg248580.pdf https://www.redbooks.ibm.com/redbooks/pdfs/sg248580.pdf
- pabs3 2y agoWhere does IBM get their CPUs fabbed? I assume they don't have their own fabs these days? Edit: its "Samsung’s leading edge 5 nm process node" according to the Telum II article linked from one of the other comments here. https://chipsandcheese.com/p/telum-ii-at-hot-chips-2024-mainframe-with-a-unique-caching-strategy https://chipsandcheese.com/p/telum-ii-at-hot-chips-2024-main... Surprising they aren't using TSMC like pretty much everyone else does.