4 ms·
Apple M5 Chip's Dual-Use Design Will Power Future Macs and AI Servers
- gautamcgoel 2y agoI read the article, know a reasonable amount about CPUs, and have no idea what the article means by 'dual-use'. Typical clickbait fluff.
- krasin 2y agoDual use as in desktops + servers.
- idontpost 2y ago[dead]
- steve1977 2y agoSo like a Xeon?
- darby_nine 2y agoWhy mention AI then?
- dagmx 2y agoProbably because Apple recently announced their Private Cloud Compute based on their own hardware that is being used to handle any Apple Intelligence features that don’t run on device.
- downrightmike 2y agoThey branded it as Apple Intelligence, they won't just say "AI" anymore
- darby_nine 2y ago:rolleyes:
- talldayo 2y agoMaybe it means they'll finally ship Apple Silicon servers that have a comparable amount of RAM to their Intel rackmount models.
- lynguist 2y agoNormally dual use means it has a possible use as a weapon. Compute power is restricted from export to enemy nations and is considered dual use. There was once a moment when a Mac had enough computing power that it was prohibited from export during a few months until the new limit was established, which was cleverly used as an ad: https://youtu.be/l2ThMmgQdpE?si=xgLsybj86ErWnGvR https://youtu.be/l2ThMmgQdpE?si=xgLsybj86ErWnGvR But in this specific case it’s utter clickbait. Dual use: https://en.wiktionary.org/wiki/dual-use https://en.wiktionary.org/wiki/dual-use
- reanimus 2y agoI don't think that they're referring to this specific phrase. I had no idea that it has this specific meaning, and I would guess most consumers don't, either. If it was clickbait, it was very bad as clickbait.
- BodyCulture 2y agoDual-use means you can use it as a nice place to put e.g. beer cans on it when closed or watch cat videos when open.
- darby_nine 2y agoIt means you're paying for functionality you're unlikely to use.
- treprinum 2y agoAre they going to bundle 8TB of RAM on the CPU now?
- AnthonyMouse 2y agoThe trick Apple plays with their laptops is to use a wide memory bus, which would traditionally require a lot of memory slots (at least one per channel), which usually has a poor cost/benefit ratio on consumer systems that are usually not memory bandwidth bound. But Apple wants to use the same memory for the GPU, which needs more bandwidth, so instead they solder it as if this is necessary (rather than just cheaper). Servers normally have a lot of memory slots, e.g. Epyc servers have more memory bandwidth than the top end Apple Silicon entirely because the servers have tons of memory channels.
- rasz 2y agoThe "wide" bus you are speaking of is so far 128Bits for both M4 8GB and 16GB configurations, same stuff you get on ordinary PC laptops.
- AnthonyMouse 2y agoBut they also correspondingly don't have any higher memory bandwidth than an ordinary PC. Obviously the "server" chips are going to want more than that. (Apple still solder the memory on the base model laptops though.)
- AndrewSwift 2y agoDual use in this case means use both in personal computers and in data centers or "cloud servers". It would be of interest because normally you'd be optimizing for very different characteristics.
- curt15 2y agoWould Apple revive OS X server or just run Linux on such AI servers?
- glhaynes 2y agoThey use a massively stripped down and modified version of iOS for their "Private Cloud Compute". https://security.apple.com/blog/private-cloud-compute/ https://security.apple.com/blog/private-cloud-compute/ See also the WWDC 2024 Platforms State of the Union video. At least some of the actual AI/server software is using Swift on Server.
- rkwasny 2y agoEven triple use if you could mount it in the cruise missile :-)
- dagmx 2y agoThe article and therefore people responding are focused on the most boring part of the rumour: “dual use” The stacked logic setup is far more interesting in terms of what it means for die density and efficiency.
- forrestthewoods 2y agoSeems like for an AI data center you’d really want a dedicated AI chip, no? The current M chips have way more CPU and GPU than inference workloads need or want, right?
- wmf 2y agoWhat if they are using the GPU for inference.
- forrestthewoods 2y agoStill a waste of CPU. Seems hard to believe that workloads would saturate both GPU and NPU. It’s got to be sub-optimal. I’m just not sure by how much. My ill informed spidey sense says by quite a bit. But I don’t know which is why I asked!
- triyambakam 2y agoI feel so left behind with an M1 MacBook. Is that on purpose? Am I supposed to feel shame and upgrade to M{LATEST}?
- ximus 2y agoThink about your needs and what you actually do with your computer, and if there would be a significant difference with an upgrade. I'm still on M1 and I know that M2 and M3 would not change my experience for my web development work. But yeah, if you're just going off the maker's marketing materials, then yeah, you'd always feel behind.
- FredPret 2y agoThe M1 is seriously good. I have a base model M1 with 16GB of RAM, and I've spent approximately zero time waiting while it processes or opens things. Granted, no gaming or number-crunching (that goes on a server!), just coding, browsers, and Excel.
- yieldcrv 2y agoUnless your RAM requirements aren’t being met, the M1 is good enough. The M2 is the best of the line so far because the M3 handicapped memory bandwidth for the only use cases that need so much memory. M4 is tempting and a decent time to upgrade if you’ve had an M1 since 2020 or 2021, but its exact specifications aren’t know for all lines yet.
- tkiolp4 2y agoIs the M3 “worse” than the M2?
- Jtsummers 2y agoOn CPU/GPU benchmarks the M3 comes out ahead of the M2 (all flavors in like-for-like comparisons, plain, pro, max). However the M3 Pro and some M3 Max's have lower memory bandwidth than their M2 counterparts. So a plain M3 is better than a plain M2. The top end M3 Max is better than the M2 Max. For the rest, you have to do a comparison and determine based on your intended use-cases, but for most people the M3 {Pro,Max} will be better than the M2 equivalent.
- daft_pink 2y agoM5? I want a Mac with an M4 but all they offer it on is an iPad Pro with virtually no functionality improvement over my current iPad Pro.
- zamadatix 2y agoGoing from the M1 to M4 is barely worth the upgrade, is it really such a big deal it's been 4 months since the last MacBook Air SoC upgrade and it'll be another ~4 months until the next round releases on its usual schedule anyways? It's not like the iPad stole away time from the MacBook cadence by releasing first.
- paulmd 2y agoN3B is such a poorly-yielding node that it’s worth actively pushing up the release cycles and get people onto the next product, which will use N3E instead.
- daft_pink 2y agoWhile I agree that it doesn’t make sense to upgrade from M1 to M4 in many cases, imagine you want to purchase a two Mac Studios that are $4k-$5k each, because you need better monitor support and i/o, but you can only purchase a really old M2 model and all the Laptops are M3 perform better but lack some i/o and the iPad is M4. It’s super nice that they overengineer everything and that’s why I buy Apple products to be honest, but they should roll out their chips in a sensible way and not leave their most expenses products at the tail end to upgrade right before their release their next chip. Plus I think that it makes sense to wait for the M4, because it will have enough TOPs to support their future AI endeavors and will have a much longer useful life than purchasing and M2 studio today.
- godelski 2y agoAre you telling me that thinner isn't better? What else could you possibly want? Native pdf editors? Better and native applications to write, take notes, draw, and edit? Being able to draw/markup an overlay on the screen regardless of the app? Ability to ssh and use the iPad like a netbook? I think you're asking too much. It was a real great achievement that they made it thinner. Real creative thinking and this provides the most utility to users! The pencil is there for aesthetics anyways. And that's the biggest crime with the new iPad. That the pencil doesn't look different, so no one can tell that I'm using the new one from a distance. Big mistake Apple. Get your priorities right. It's not about making better technology, it is about status and getting rich. Obviously it is impossible to both make better technology and get rich at the same time, and we know which is more important.
- andrewmcwatters 2y agoI wonder what the internal experience is like SSHing into one of these Apple Cloud Server boxes. I mean, sure, it’s similar to what you’d surely get running Terminal.app, but I mean I doubt Apple engineers are doing some internal equivalent of apt when they need something. There’s brew, but it would be… awkward if that’s what they used in their private cloud fleet.
- tensor 2y agoPresumably they build .pkg or .mpkg files and use those?
- saagarjha 2y agoThey can’t SSH into those machines.
- JimDabell 2y agoApple’s article on how their Private Cloud Compute system works is a good read if you are interested in the details. > First, we intentionally did not include remote shell or interactive debugging mechanisms on the PCC node. Our Code Signing machinery prevents such mechanisms from loading additional code, but this sort of open-ended access would provide a broad attack surface to subvert the system’s security or privacy. Beyond simply not including a shell, remote or otherwise, PCC nodes cannot enable Developer Mode and do not include the tools needed by debugging workflows. — https://security.apple.com/blog/private-cloud-compute/ https://security.apple.com/blog/private-cloud-compute/
- jimnotgym 2y agoApple are making servers again?
- ltadeut 2y agoYeah, they somewhat hinted at it in their WWDC announcement about private AI. They are running models on apple hardware. If you look up their jobs portal you can see some roles that also seem to hint at that (OS and kernel teams)
- usrusr 2y agoThey've been making servers for quite a while I think. They just don't sell them, and I certainly would not expect that to change any time soon.
- mise_en_place 2y agoI could really see this taking off. Sagemaker is garbage and hugging face interfaces are laggy and buggy. The future is on-prem bespoke models you can run on commodity NPU SoCs. On my M3 MacBook I’ve been running local models like Llama-70B instead of ChatGPT for a while now.
- troupo 2y agoIt will be funny to see Apple crack under pressure from the AI bubble. They have been severely mismanaged for a decade by forcing mandatory yearly upgrades across all of their stacks. In the past several years the cracks have started to show in their software (bugs lingering for years, features being delayed for months after yearly OS upgrades etc.). Hardware teams seemed to be mostly immune from it, and delivered insane results. Now it's "omg must have AI don't matter if you're ready for it or no. Upper management saw LLM demos and are now forcing it everywhere. What do you mean you had other plans for M5? It's AI now damn it"
- deleted 2y ago[deleted]