5 ms·
I wonder what motivates apple to release features like RDMA which are purely useful for server clusters, while ignoring basic qol stuff like remote management o
by chis 10mo ago
I wonder what motivates apple to release features like RDMA which are purely useful for server clusters, while ignoring basic qol stuff like remote management or rack mount hardware. It’s difficult to see it as a cohesive strategy.
Makes one wonder what apple uses for their own servers. I guess maybe they have some internal M-series server product they just haven’t bothered to release to the public, and features like this are downstream of that?
- vsgherzi 10mo agolast I heard for the private compute features they were racking and stacking m2 mac pros
- jeffbee 10mo agoI honestly forgot they still made the Mac Pro. Amazing that they have these ready to ship on their website. But at a 50% premium over similar but faster Mac Studio models, what is the point? You can't usefully put GPUs in them as far as I know. You'd have to have a different PCIe need to make it make sense.
- deleted 10mo ago[deleted]
- Asmod4n 10mo agoall PCIe lanes combined in that machine can do over 1 terabit. Would be quite the networking beast.
- jeffbee 10mo agoThe M2 Ultra has 32 off-world PCIe lanes, 8 of which are obligated to the SSDs. That leaves only 24 lanes for the 7 slots. That's 8 times less than you'd get from an EPYC, which is the kind of thing a normal user would put in a rack if they did not need to use macos.
- xienze 10mo ago> rack mount hardware I guess they prefer that third parties deal with that. There’s rack mount shelves for Mac Minis and Studios.
- mschuster91 10mo agoThere's still a lot - particularly remote management, aka iLO in HP lingo - missing for an actual hands-off environment usable for hosters.
- xienze 10mo agoI know it’s not exactly IPMI, but don’t those little external IP KVM modules work well enough to do remote admin of Macs?
- geerlingguy 10mo agoThe annoying thing is there's no ability to control power (or see system metrics) outside the chassis. With servers and desktop PCs, you can usually tap into power pins and such.
- jeffbee 10mo agothunderbolt rdma is quite clearly the nuclear option for remote management.
- rsync 10mo agoThese are my own questions - asked since the first mac mini was introduced: - Why is the tooling so lame ? - What do they, themselves, use internally ? Stringing together mac minis (or a "Studio", whatever) with thunderbolt cables ... Christ.
- sneak 10mo agoI assume a company like Apple either has custom server boards with tons of unified memory on M series with all the i/o they could want (that are ugly and thus not productized) or just use standard expensive nvidia stuff like everyone else.
- doctorpangloss 10mo agothe answer is even more boring, they use GCP haha
- solarkraft 10mo agoIt’s quite interesting how „boring“ (traditionally enterprise?) their backend looks on the occasional peeks you get publicly. So much Apache stuff & XML.
- hamdingers 10mo ago> I guess maybe they have some internal M-series server product they just haven’t bothered to release to the public, and features like this are downstream of that? Or do they have some real server-grade product coming down the line, and are releasing this ahead of it so that 3rd party software supports it on launch day?
- MBCook 10mo agoThat they sell to the public? No way. They’ve clearly given up on server stuff and it makes sense for them. That they use INTERNALLY for their servers? I could certainly see this being useful for that. Mostly I think this is just to get money from the AI boom. They already had TB5, it’s not like this was costing them additional hardware. Just some time that probably paid off on their internal model training anyway.
- re-thc 10mo ago> That they sell to the public? No way. They’ve clearly given up on server stuff and it makes sense for them. Given up is not a given. A lot of the exec team has been changing.
- pjmlp 10mo agoSome people are still hoping they care for some of their older customers. https://cottonbureau.com/p/4RUVDA/shirt/mac-pro-believe-dark#/30018634/tee-men-premium-lightweight-vintage-royal-tri-blend-s https://cottonbureau.com/p/4RUVDA/shirt/mac-pro-believe-dark...
- ascagnel_ 10mo agoAnd if the rumors are right -- that hardware SVP John Ternus is next in line for CEO -- I could see a world where the company doubles-down on their specialized hardware vs. services.
- MBCook 10mo agoThey’ve done a dip-in-a-toe thing many times, then gave up. If I was in charge of a business, and I’m an Apple fan, I wouldn’t touch them. I’d have no faith they’re in it for the long term. I think that would be a common view.
- almostgotcaught 10mo agoI don't know what you're bemused by - there's no mystery here - you can read the release notes where it literally says this was added to support MLX: https://developer.apple.com/documentation/macos-release-notes/macos-26_2-release-notes#New-Features https://developer.apple.com/documentation/macos-release-note... Which I'm sure you saw in literally yesterday's thread about the exact same thing.
- solarkraft 10mo agoThe comment is about the larger strategy surrounding that.
- Melatonic 10mo agoDo they run any of their own datacenter stuff ? I thought they just outsourced to GCP
- re-thc 10mo agoThey have some of their own, also use AWS and others too.
- spacedcowboy 10mo agoAWS is just used for storage, because it's cheaper than Apple maintaining it, itself. Apple do have storage-datacenter at their campus at least (I've walked around one, it's many many racks of SSD's) but almost all the public stuff is on AWS (wrapped up in encryption) AFAIK. Apple datacenters are mainly compute, other than the storage you need to run the compute efficiently.
- stetrain 10mo agoAll of the Private Cloud Compute stuff they are working on runs on their own Apple Silicon server hardware. https://security.apple.com/blog/private-cloud-compute/ https://security.apple.com/blog/private-cloud-compute/ https://www.apple.com/newsroom/in-the-loop/2025/10/shipping-apples-american-made-advanced-servers/ https://www.apple.com/newsroom/in-the-loop/2025/10/shipping-...
- raw_anon_1111 10mo agoThey outsource to GCP and AWS. An Apple executive has been on stage at ReInvent for the past couple of years
- erik 10mo agoThe Mac Studio, in some ways, is in a class of its own for LLM inference. I think this is Apple leaning into that. They didn't add RDMA for general server clustering usefulness. They added it so you can put 4 Studios together in an LLM inferencing cluster exactly as demonstrated in the article.
- oofbey 10mo agoBlog posts like this one are great marketing.