6 ms·
Teardown: Identifying Apple M1's distinct circuit blocks
- macrael 6y agoThis article does not appear to do what the title claims. It mostly rounds up news from other sources. Has anyone done the actual analysis of what the dedicated logic cores on the M1 are? I'm always curious what kinds of work Apple dedicates hardware to.
- olliej 6y agoI agree, the article contains nothing new, most regurgitates or links to other articles. Despite the large chip image at the head of the article there is no discussion or description of the silicon.
- comboy 6y agoIs it really possible to get such analysis if you're not a macos developer? From a layman point of view, I would take a list of instructions executed during common case OS usage and then extract the most common patterns (basically compression) and put them into silicon. These wouldn't be easy to understand if you don't know exactly what the OS is doing and how. I mean of course you need some cleanup and well thought-out design for future software development, but I wouldn't be surprised if in the future, to get the full experience of a new OS you will also need to update the hardware.
- shard 6y agoLooking at the die shot, the CPU, GPU, and NPU jumps out, if you've seen a bunch of other die shots before, and combine that with the core counts that Apple announced. For less obvious blocks, engineers with the right specialties might be able to make a guess. Otherwise thermal imaging would allow some guesses when running targeted algorithms.
- olliej 6y agoThe die shot image comes from the eetimes page they link to.
- ForHackernews 6y ago"There are no secrets in silicon" A determined enough team of people with sulfuric acid and electron microscopes could work out exactly what is going on inside the chip. (not that anyone would actually do this - maybe Intel? But at least in principle, the information is accessible to non-Apple folks)
- dismalpedigree 6y agoWe do. This is what we have publicly disclosed about our findings thus far. https://www.techinsights.com/blog/two-new-apple-socs-two-market-events-apple-a14-and-m1 https://www.techinsights.com/blog/two-new-apple-socs-two-mar...
- comboy 6y agoIs it common to put fake features in silicon to make reverse engineering harder?
- dismalpedigree 6y agoNot really (that i have seen). I am not an analyst though, so not a guarantee. Die real estate is extremely expensive. Plus it wouldn’t really throw us off the scent due to the techniques we employ.
- simonh 6y agoThey actually did this in the M1 for retain/release for Objective-C and Swift objects. It's an extremely common operation on the platform and is 4x faster on M1 natively, and still 2x faster than native Intel under Rosetta.
- mhh__ 6y agoThis is effectively what happens anyway because the CPU manufacturers beat each other over the head with various benchmarks, but it's worth saying that very little area of a modern CPU is actually taken up by functional units like adders
- varispeed 6y agoAre there any home made methods to take picture of the chips like this? What tools would you use to sand the top of the chip? What type of microscope would work?
- ckocagil 6y agoFor regular ICs I put them in a test tube with nitric acid and heat it to extract the die. Then to image the die you'll need (in order of preference) an electron microscope, or a metallurgy microscope, or a regular bio microscope.
- diarmuidie 6y agoThe process of removing a chips encapsulation is called Decapping if you're looking for a search term. https://en.wikipedia.org/wiki/Decapping https://en.wikipedia.org/wiki/Decapping
- marcan_42 6y agoTo get the die off the flip chip carrier I use heat and scraping. Then I use a razor blade to scrape off most of the metal layers (which obscure the functional blocks), then a cheap Chinese inspection microscope ($100) attached to a DSLR with a 3D printed adapter (a DSLR with a lens attached backwards also works in a pinch). Then take a bunch of individual photos and stitch them with Hugin. Results: https://marcan.st/transf/latte_stitched.jpg https://marcan.st/transf/latte_stitched.jpg Edit: sorry, the link was previously the (lower res!) Chipworks shot I'd annotated previously. I got confused. Replaced with mine. It's less clean but higher resolution than what they released. At the highest zoom I could get I could just about make out individual bits in the eFuse array. This is a Wii U GPU (Latte). https://marcan.st/transf/latte_otp_slr.jpg https://marcan.st/transf/latte_otp_slr.jpg No chemicals needed. I'm probably one of very few people crazy enough to do this mechanically, but it clearly works! Here's a single shot done with a reversed cheap kit Canon lens of a PS3 GPU (RSX), again with the scraping method. https://marcan.st/transf/rsx.jpg https://marcan.st/transf/rsx.jpg I do happen to have access to a SEM too, and obviously that gets a lot more fun. Here's the same eFuse area (again this is still the mechanically deprocessed chip!): https://marcan.st/transf/sem/latte/20161210_201044.png https://marcan.st/transf/sem/latte/20161210_201044.png I think the mechanical delayering usually gets me to M1 or so, though it's not completely consistent depending on the specific process. Some chips work better than others.
- loudmax 6y agoI'm not sure what to make of that Neural Engine. I was under the impression that most machine learning was using GPUs. The M1 already has a large GPU, so I'm surprised that the chip developers decided that a dedicated neural processor was worthwhile, especially in the middle of those CPUs. Also, what kinds of jobs is that neural engine for? Presumably voice and face recognition to start with, but that doesn't strike me as enough to justify that die space. Good for research of course, but Apple seems to focus on what's practical for everyday users. I've seen stories about CPU designers wanting to use machine learning to manage system cache. I wonder if the NPU will be involved in managing the workload of the M1 chip itself.
- chongli 6y agoIt’s an interesting question. For one, I know that the Photos app on Macs and iPhones tends to spend loads of time going through your photos and recognizing everyone’s faces. Due to Apple’s stance on privacy, they’ve emphasized that this task should be performed on device, not in the cloud. Without the neural engine, the processing of tens of thousands of photos can be a real burden on a typical MacBook. Apple has tried to throttle the process so that it doesn’t peg the CPU, but then it takes a lot longer to complete. The neural engine lets the process run full out without consuming a ton of power.
- rahkiin 6y agoIt is also used for Siri, for automatically making albums for Photos, finding people in Photos. I think the NPU is not as power hungry for inference than the GPU is for the same job.
- bacon_blood 6y agoMost machine learning is using _NVIDIA_ GPUs, which themselves have a neural engine (tensor cores) for the last two generations. An NVIDIA A100 has around 19 Teraflops but 156 "tensor flops" (312 if you use sparse matrices). In addition to being useful for training and inference, the consumer cards use tensor cores for things like mic filtering (RTX Voice) and neural upscaling (DLSS) in games. General purpose GPU hardware is way more wasteful for matrix math, like maybe >10x waste on power and equally worse performance, than tensor cores.
- rahimiali 6y agoHere is a better article that actually does what the title claims: https://www.anandtech.com/show/16226/apple-silicon-m1-a14-deep-dive https://www.anandtech.com/show/16226/apple-silicon-m1-a14-de...