9 ms·
Tour of new custom M1 macOS runners racks with Christina Warren [video]
- adhesive_wombat 3y agoSeems completely nuts that you have the "shuck" entire assembled computers for this. Reminds me of the story about the Soviet factory ordering tractors just to remove some component like a single bearing for manufacturing something else.
- prettyStandard 3y agoI agree it's nuts and wasteful. It seems like Microsoft & Apple could come up with an arrangement to reduce their waste.
- Maxious 3y agoEven AWS tucks mac minis into a rack https://aws.amazon.com/blogs/aws/new-amazon-ec2-m2-pro-mac-instances-built-on-apple-silicon-m2-pro-mac-mini-computers/ https://aws.amazon.com/blogs/aws/new-amazon-ec2-m2-pro-mac-i... Perhaps a policy holdover from the late 90s https://www.wired.com/1997/09/apple-kills-clone-market/ https://www.wired.com/1997/09/apple-kills-clone-market/
- washadjeffmad 3y agoIf you take the innards out of any model Mac and 3D print your own mounts, you can get some crazy density. There's basically nothing in them.
- JKCalhoun 3y agoApple did once sell 1U server racks [1]. I assume the reason they no longer sell these is because the market has spoken. [1] https://en.wikipedia.org/wiki/Xserve https://en.wikipedia.org/wiki/Xserve
- deleted 3y ago[deleted]
- SloopJon 3y agoI somehow expected more density for a custom arrangement like this. One eviscerated mini per sled, ten sleds per rackmount chassis, six chassis per rack: sixty minis in 42-48U. Sonnet's RackMac mini[1] puts two unmolested minis in a short 1U enclosure: sixty minis in 30U. A web search turns up the Apple Mac Mini Relay Rack Shelf[2] from RackSolutions, which has four minis in a full 1U enclosure. I'm willing to believe that there are cooling and airflow advantages to the sleds, although those two small fans at the back of the sled don't look too exciting. The biggest advantage seems to be cable management and the ease of sliding out a single mini at a time. One comment on the video points to another video[3] about MacStadium, which mounts minis sideways on what look like library shelves. [1] https://www.sonnettech.com/product/rackmacmini.html https://www.sonnettech.com/product/rackmacmini.html [2] https://www.racksolutions.com/mac-mini-shelf.html https://www.racksolutions.com/mac-mini-shelf.html [3] https://youtu.be/0b46E4mp_V8 https://youtu.be/0b46E4mp_V8
- leehuffman 3y ago> I somehow expected more density for a custom arrangement like this. One eviscerated mini per sled, ten sleds per rackmount chassis, six chassis per rack: sixty minis in 42-48U. If Apple isn't willing to manufacture an off-the-shelf offering, what did you expect? That's... pretty dense... As far as off-the-shelf desktop things turned in-house rack mount sled chassis builds go, 60 Minis in 48U (with _all_ the supporting bits – multiple network switches etc) is pretty damn good? > I'm willing to believe that there are cooling and airflow advantages to the sleds Nah the benefits are all management, maintenance, and isolation. Not to mention the sled chassis providing A/B power feed support, IPMI-esque management from the host chassis for each sled, etc etc. The benefits are massive and have nothing to do with cooling/airflow. > although those two small fans at the back of the sled don't look too exciting. I can assure you those 40mm fans _scream_. > The biggest advantage seems to be ~~cable management~~ and the ease of sliding out a single mini at a time. Bingo. Single sled failure and the ability to swap to a spare/repair the broken one outside of production by pressing your thumb on a trigger and pulling towards you. Huge win vs the off-the-shelf 'rack your factory Mini in this metal cage on rack rails' scenario. Not to mention you now have the ability to assign jobs/builds intelligently at a sled/host chassis level. Isolation & proper distribution of jobs at that granularity (and cabinet, power phase feed consumption, A/B feeds, cabinet row(s), etc) is very valuable. This shit is really, really dope.
- diimdeep 3y ago[flagged]
- keepamovin 3y agoSmart girl giggles is the best giggles tho.
- alufers 3y agoI wonder how bulletproof Apple's macOS license is. Perhaps one could find a country where the "you can't run it on non-Apple hardware" clause is not valid, and get some good lawyers. Then just run a standard data center with normal multi-socket virtualization servers, and for each one buy a dead mac to have the rights to the software. Perhaps one could hot glue a powered off Apple motherboard inside of this server and claim that it is Apple hardware now. Maybe it's risky, but you could easily compete on the per hour price with these shops, that have to buy actual macs, disassemble them and run all this custom infrastructure to support this.
- anshargal 3y agoThe days of x86 macOS are numbered. I don't think there are good ways for running ARM macOS on non-Apple ARM CPUs and I am not even sure there are ARM servers comparable with M1 in single-core performance (maybe latest AWS Graviton?)
- pjmlp 3y agoWith ARM Macs, Apple has killed the Hackintoshes, which I never found appealing anyway. It was like those folks that put Ferrari logos on red Fiat sport models. Either get the real deal or something else
- avidphantasm 3y agoYeah, I never understood the appeal. macOS but you have to mess around with hardware and drivers. No thanks. The appeal of macOS is that it just works with Mac hardware.
- yardie 3y agoMessing around with hardware and the software that runs on it is how you really learn how computers and software work. The original Mac SE and Mac IIs came withe a hardware debugger you could enter anytime with a literal button on the front. If I wanted buttoned up single-use OS there is iOS. But almost no one wants that as their primary OS because they want the customizable, extensible OS.
- mariopt 3y agoThe idea of using thunderbolt to extend a motherboard is pretty smart and can be used for many laptops, I wish they would sell this to people who want to reuse some broken laptop and turn it into a server. Still wondering if it makes financial sense since you could just build a custom rack to pack as many mac minis as possible, even at cost of buying storage from Apple.
- ex3ndr 3y agoyou can buy pcie extensions easily on amazon.
- yellow_lead 3y agoSad to see this much e-waste, especially when Apple highlighted their environmental initiatives so much at their most recent wwdc.
- cromka 3y agoYou don’t know it’s e-waste. Most likely they sell those part in bulk to a 3rd party.
- mikeweiss 3y agoIt's still wasteful. Shipping around unneeded parts that maybe will be reused?
- windowsrookie 3y agoPossibly, but is there even a market for the parts they are not using? How many people are replacing M1 mini parts?
- callalex 3y agoIf Apple actually cared even one iota about the environment then every machine and headphone would have a replaceable battery. Everything else is greenwashing.
- dijit 3y agoAlmost no detail of any kind except 60 instances in a rack, and a very brief look at the chassis. I got the impression that the guide didn't know anything about what they were talking about w.r.t internals or how it's used, but that could be sexism or racism I guess. At no point did they mention anything about why there was an external thunderbolt network controller (or why it was so big). No information about orchestration or storage or... any detail at all really. "here's a fan, there's a thunderbolt ethernet", "it fits like this". Very surface level, which is annoying because its very clearly marketing for developers or technical people who even care about GitHub.
- eurekin 3y agoIt was a weirdly undetailed video.
- subjectsigma 3y agoThey are both in high-level senior management roles and are pretty young. Most people I have encountered like that are not very technically skilled, regardless of race or gender. Either way it’s a marketing video, probably best not to read too much into it.
- lwkl 3y agoThey both have at least a decade experience in the industry and Iccha Sethi seemed like a knowledgeable engineer. She also seemed pretty genuine and enthusiastic about her team's work on this. The video is just pretty short and very surface level and it would've been better if it was an 8 - 10 minute video. Then they could have included the people taking the things apart and put some shots of actual work being done in.
- keepamovin 3y agoThey didn't give details but it might come across as rude to assume they didn't know anything. The guide is introduced as a director of engineering, IIRC. One rational and charitable interpretation based on that is that they know way more than you do. Also, even without that introduction, I got the opposite impression. The lady seemed very knowledgeable and had that melding of professionalism, persona and super-smarts that is common is very high performers, in my experience. Sure, it didn't cater to your exact technical expectations of what the video should have, but such an expectation could be considered somewhat narrow, and it may be difficult to argue that therefore it is without merit. Your point about it seeming to miss the point of its intended audience is well-taken but may result from an a super narrow understanding of the audience segment you mention, which is likely more diverse than suspected. Also, the context suggests it was designed as a mix of PR, marketing, and technical sneak peak / curio, which it seemed to achieve well. Your self-awareness of how this could be the result of sexism or racism is commendable but by surfacing your awareness of it, it comes across as less likely to be the cause, so I'm going to assume it's some other reason for now! hahaha! :) Overall your comment could come across as somewhat strident and narrowly focused dismissal of something, and someone, with lots of value! Perhaps you just missed that for whatever reason? That's ok! :)
- mysteria 3y agoI wonder when will be the time when Apple themselves just give in and create something like a M core Xserve. They stopped selling them as they weren't popular, but at that time Macs simply weren't popular. Apple themselves would make good use of the Xserve for their own internal use rather than buying Dell/HP servers like they currently do. Also things like Xcode cloud are currently running on x86 commodity servers, in the future Apple likely will stop supporting x86 altogether and it makes sense to run it on AS. They could reuse the high-end Mac Studio or similar chips and only have a custom board and chassis suitable for server use, with additional IO and redundancy. And for those saying that Apple isn't interested in large deloyments, they literally make the Mac Pro in rackmount form for render farms and so forth. The Mac Mini has 10G ethernet and the formfactor purposely hasn't changed. The chips are efficient enought that you don't need screaming loud 1U fans and they could definitely create a quiet 1U Studio suitable for both dense datacenter deployments and a TV studio technician's rack.
- leonheld 3y ago> rather than buying Dell/HP servers like they currently do I wonder what kind of software/OS they run on those machines.
- mysteria 3y agoAFAIK it's simple virtualized x86 MacOS. Their EULA doesn't apply to them of course so they can run it on whatever they like.
- 2OEH8eoCRo0 3y agoEULA for thee, but not for me!
- xattt 3y agoMy understanding was that Xserve, and the corresponding OS X Server, were discontinued because performance for Apple-rolled server software sucked ass. There were at least a few threads on Apple’s forums where people were redirected to community-supported software. There is a fairly strong use-case now with robust software, but I feel like Apple wants to maintain an illusion that their developers are small mom-and-pop shops with a Mac Mini in corner of their farmhouse.
- swozey 3y agoI am so happy that I don't run mac farms for building a teams ios apps anymore. Everything about dealing with apples developer ecosystem was an absolutely miserable experience, from not being able to virtualize for ci builds to having to appeal half of our (we made 250-300 apps a year for events that were based on the same template, so near clones with different assets) apps rejected and allowed on appeals sort of things. Android was the polar opposite. Absolutely ridiculous that I would need an entire mac mini/studio to run ONE CI job at a time. Always felt like Apple didn't WANT us to make apps. This was 2014ish though. Is it a lot different now?
- bsaul 3y agoSame. i can't wait until i get out of the apple dev ecosystem. And i've been in it since the iphone 3gs. Everytime i work on web or backend it's like a breath of fresh air. The amount of opaque , undocumented, disfonctionning proprietary garbage one has to put up with is just depressing.
- ricardobeat 3y agoLast setup I worked on, we rented out M1s from Hetzner, and each machine could run 2 builds simultaneously. XCode makes pretty good utilization of all cores so there isn’t much benefit to parallel runs in the same machine vs a queue. We also used it for JS builds as it was way faster than the Intel runners, and 3-4x faster than GitHub’s own M1 hosts.
- manmal 3y agoI‘m currently setting up iOS CI, and got excited when you mentioned Hetzner, but turns out this has been abandoned. Scaleway seems like a good alternative, but 4 months of that is roughly equal to buying a refurbed machine. Since self hosted runners are easy to setup, we‘re really thinking about letting them run onsite.
- suryao 3y agoCheck out warpbuild.com - I'm the founder and we have ios runners that are cheaper than the github equivalent.
- jasoneckert 3y agoVery nice and clean design - however, it seems to me like there is easily enough room for two Mac Mini M1s per sled without affecting the cooling and achieving a density of 20 per rackmount enclosure and 120 per rack. I'm also curious as to whether GitHub considered (or is considering) running Asahi Linux natively on them - the latter would make more sense to me as it could easily blend into their existing infrastructure.
- dijit 3y agoWhy would you run a linux on these? there are much better server grade systems that linux works on. The benefit of these devices is running MacOS, and virtualizing it is not going to give many benefits that aren’t natively available in Macos already.
- jasoneckert 3y agoAsahi Linux performs far better on Apple Silicon hardware compared to macOS for server-related tasks (https://jasoneckert.github.io/myblog/ultimate-linux-arm64-workstation/ https://jasoneckert.github.io/myblog/ultimate-linux-arm64-wo...)
- justinclift 3y agoAny luck with virtualising macOS itself on that? :)
- thfuran 3y agoBut the point of buying the Mac hardware is so that you can run macos.
- cedws 3y agoWith one machine per sled you can easily isolate it and remove it for repairs if it breaks. If you packed two or three on to a sled you'd have to take all of them out of service. The cost difference probably isn't too big.
- windowsrookie 3y ago
- jzl 3y agoNothing will ever compare to the inefficient absurdity of server racks of 2013 “trash can” Mac Pros. https://9to5mac.com/2018/11/01/mac-server-room/ https://9to5mac.com/2018/11/01/mac-server-room/
- ATMLOTTOBEER 3y agoThe audio on this is really strange, like the Indian woman’s voice is ai generated. Does anyone else hear some kind of warbling in their voices?
- astrange 3y agoIt sounds like she's trying to talk over something to me. I think there was some loud AC running they edited out. The video is also a little too color graded?
- justinclift 3y agoThe title of this really needs "GitHub" in it somewhere.
- jbverschoor 3y agoIt's more a Christina Warren promo video than Github. Edit: her linkedin handle is "filmgirl".. I wouldn't be surprised if she's leaving the company within a year to become a 'creator'. She has a good track record in tech.
- pram 3y agoI'd assume the big "innovation" here is that the networking card in the sled offers lights-out management.
- jbverschoor 3y agoI first got the impression it was by CNBC or something. For a marketing video by github itself, presented by a senior developer advocate.. This is not the way to excite developers at all.. I'd rather look at anything by backblaze, the datacenter cooling tech by meta, or even any marketing video of the old XServe for that matter.
- NoPedantsThanks 3y ago[flagged]
- bsaul 3y agois anyone here using github actions for running ios app tests & push to the app store ? what's your xp ?
- ricardobeat 3y agoI wonder why go the trouble of gutting them to put into a new case. Other hosting providers like MacStadium simply slot the whole machine into racks: https://www.macstadium.com/blog/first-look-mac-mini-with-m2-pro https://www.macstadium.com/blog/first-look-mac-mini-with-m2-...
- lr1970 3y ago> I wonder why go the trouble of gutting them to put into a new case. two words -- power supply.
- lijok 3y agoGutting mac minis to retrofit into blades. Producing tons of e-waste in the process. All because Apple wont enter the server space. Insane. How come they're not including the impact of what they decide NOT to do, into their climate impact calculations?
- bodyfour 3y agoI can understand reasons they won't (re-)enter the server space themselves. However it is a shame they don't sell bare boards for specialist integrators to build these sorts of products with.
- dboreham 3y ago> All because Apple wont enter the server space. Because they won't allow virtualization.
- deleted 3y ago[deleted]
- CharlesW 3y agoThey do, and the standard macOS SLA specifies the rights you have as an individual customer. I'd assume that custom volume licenses are negotiable.
- iampims 3y agofwiw Apple entered and then exited the server space a while ago.
- runjake 3y agoApple has no moral obligation to enter the server space. Mac Minis aren’t designed for data center use. This is a hack. Apple was in the server space and they were terrible at it[1]. Further, macOS is a terrible, inflexible server OS. Linux is king, for better or… well, for the better. 1. I worked for an organization that was part of a pilot into Apple’s enterprise push and I felt like it was more of a marketing effort than an honest attempt.
- mike_hearn 3y agoSo much effort, just to run Xcode remotely. For those of you who want to ship code to macOS from CI (e.g. Electron apps), you should check out my companies product at https://hydraulic.dev/ https://hydraulic.dev/ ... it lets you package, sign, notarize and upload self-updating Mac apps from any OS including Linux. Amongst other things it bundles Sparkle on the fly also, so you don't have to deal with Squirrel, and it can do the same trick for Windows. This lets you use standardized Linux CI runners to automate the entire build pipeline. Obviously if you're writing a native app, you will still need Mac CI machines to compile, but if you're shipping Electron or JVM apps then it isn't necessary. The necessary binaries will be downloaded by Conveyor and bundled with the app automatically. You just provide the platform neutral artifacts as inputs, so a Mac CI runner can be avoided entirely. Which is useful because all that effort GitHub have to do make Mac CI expensive.
- deleted 3y ago[deleted]
- chx 3y agoI am sure reassembling a Mac Mini into a custom shed makes sense on the scale of GitHub but for smaller companies https://www.racksolutions.com/mac-mini-shelf.html https://www.racksolutions.com/mac-mini-shelf.html usually suffices.
- BirAdam 3y agoThe virtualization stuff and extreme energy efficiency are reason enough for Apple to get back into servers. There’s also the rack mount Mac Pro. The thing is, many server use cases would benefit from remove a lot of macOS end-user user-space fluff. Apple would want to reintroduce something like standalone Darwin images but with the Apple virtualization framework added back in. I don’t think Apple will do any of this soon, but a business deploying thousands of Macs may want Mac servers.
- dangus 3y agoThere’s a reason Mac minis 1. Still exist 2. Have a 10Gb Ethernet option for a computer that is supposedly a desktop ideal for Grandma’s emails. Apple knows that people use them as servers.
- cedws 3y agoApple don't even have to sell server hardware. They could build an IaaS service relatively easily and undercut every existing cloud Mac company on price. Easy win for next quarter profits too. Maybe they don't want to be a cloud provider, but they're missing out on a lot of money.
- xvector 3y agoAt least when I used to work at Apple ~4 years ago, our internal clouds were nowhere near the robustness needed to open up to the public. Poor security/isolation controls, outages, clunky usage, etc. Apple's cloud software engineering muscle is fairly weak and providing an IaaS might be "easy" for the hardware side of the company, but very difficult for the software side.
- Cheer2171 3y agoBut why couldn't they build out that capability? They could go on a hiring spree with all their cash and the state of the tech job market. Apple often goes into new market areas. Surely Apple is farther along in the cloud services game than they were in the VR game when they decided to go all-in into VR, or same for wearables, phones, music...
- newsclues 3y agoWhy did Apple create the xserve line to start with?
- CharlesW 3y agoThe target market for Xserve and Xsan included creatives (video servers, render farms, etc.), education, and science/biotech. Note that the Xserve was just the last of an interesting history of Apple servers. I'm especially fond of this 1996 behemoth: https://oldvcr.blogspot.com/2023/11/the-apple-network-servers-all-too.html https://oldvcr.blogspot.com/2023/11/the-apple-network-server...
- chx 3y agoFun story: thanks to Xsan you can buy Thunderbolt SAN devices from various vendors. Now, the Areca ARC-8050T3 SAN with its 9 Thunderbolt inputs has become insanely popular on movie / commercial sets. Drop it into a 4U rolling case and it becomes the motherlode where everyone, no less than nine people at the same time can just plug a Macbook in without any problems, configuration, maintenance or anything. Just works. It pushed Areca to make optical TB3 cables, in fact, now people don't need to stay so close to the motherlode.
- larkost 3y agoThe prime reason for the Xserve line was to have a Mac Server that could go into schools' server closet to help manage all of the Macs in a school. It got sold in lots of other places for various things (e.g. that supercomputer at the time), but that was the overwhelming reason at Apple. The whole project long the things that got done on it were things that schools needed. There are a lot of schools, but once you have one in each (that had a large Mac presence), there was not a lot of growth room. I was working at the University of Wisconsin (Madison) at the time, and we had a grand total of 6 in our data center (yes there were more on campus, but in ones and twos in departments), and no big reasons to have more. And as much as I love working on MacOS, it (like Windows) is not well setup for use as a non-interactive node (e.g.: server or data processor node): the GUI gets too much priority, the filesystem is really slow to sync, and there are unexpected edges in setup.
- NoPedantsThanks 3y ago"Runners?" I've been working in software development for a long time, and currently write mobile apps... but I've never heard this term. Now hurry and flag this totally innocuous observation again.