11 ms·
ARM64 and You
- corresation 13y agoFirst, a note on the name: the official name from ARM is "AArch64", but this is a silly name that pains me to type. Apple calls it ARM64, and that's what I will call it too. What ARM calls ARM related periphery is canonical, whether you think it's silly or not. However the overarching entity is called ARMv8, with the 64-bit state called AArch64 (which can be contrasted with the AArch32 state, which is also a part of ARMv8) and the instruction set is actually called A64.
- mikeash 13y ago"What ARM calls ARM related periphery is canonical, whether you think it's silly or not." And why, exactly, should I care?
- pohl 13y agoBecause the canon contains the words of consecration, by which we dedicate ourselves to divine purpose.
- corresation 13y agoMaybe you don't, however the comment was really more generally targeted given that we're discussing it here. However when you start renaming things, other things start to not make sense. For instance- "It's important to note that ARM64 includes a full 32-bit compatibility mode that allows running normal 32-bit ARM code without any changes and without emulation." If ARM64 == AArch64 (which is what you decided), then no, this doesn't make sense. ARMv8 includes both AArch64 and optionally AArch32, the former running A64, the latter running traditional ARM. There are ARMv8 designs that actually can't run any traditional 32-bit code.
- mikeash 13y agoAs I pointed out, that's Apple renaming it, not me. I'm just following their lead. As for 32-bit compatibility, that has nothing to do with renaming, it's just me being imprecise. It would be equally imprecise if I had used "AArch64". Thank you for pointing it out, though, I've fixed it to say that it is the A7 that includes 32-bit compatibility.
- Someone 13y agoNot all official names survive a confrontation with reality, where 'easier to remember' and 'easier to pronounce' have value, too. Do you use the terms IA-32e and EM64T, too (both are/were Intel's official names for what people now typically call x64 or x86-64)?
- maaku 13y agoEM64T & x86_64 only exist because Intel has too much pride to call it what it is: AMD64.
- scott_karana 13y agoThe name "x86_64" existed before AMD fully released their CPUs, and was latched onto by some of the open-source communities, so that specific one isn't exactly Intel's. But you're right about EM64T. :)
- ChuckMcM 13y agoI do not believe this is true. Do you have a reference that used that name x86_64 before Intel shipped its first AMD64 compatible CPU?
- maggit 13y agohttp://en.wikipedia.org/wiki/X86-64 http://en.wikipedia.org/wiki/X86-64 says "Prior to launch, "x86-64" and "x86_64" were used to refer to the instruction set. Upon release, AMD named it AMD64." and refers to https://wiki.debian.org/DebianAMD64Faq https://wiki.debian.org/DebianAMD64Faq which says ""AMD64" is the name chosen by AMD for their 64-bit extension to the Intel x86 instruction set. Before release, it was called "x86-64" or "x86_64", and some distributions still use these names." I, myself, had an AMD Opteron machine on which I ran an x86-64 build, with that name for the architecture, of SUSE Linux before Intel released their EM64T.
- scott_karana 13y agoHere's a source to back up maggit's Wikipedia citations: http://www.amd.com/us/press-releases/Pages/Press_Release_715.aspx http://www.amd.com/us/press-releases/Pages/Press_Release_715... Dated 8/10/2000.
- sanxiyn 13y agoI personally use Debian port names. Debian is pretty sensible about it. Debian uses "amd64" and "arm64".
- justincormack 13y agoIs there also a new registers but 32 bit pointers model like x32?
- rsynnott 13y ago> What ARM calls ARM related periphery is canonical, whether you think it's silly or not. Ah, yes, that must be why everyone in the world calls the 64bit x86 instruction set either AMD64 or IA-32E.
- corresation 13y agoIn this case the author directly conflates an architecture, state, and instruction set, which is exactly why this sort of 'well I will call it...' Nonsense is ill advised. But hey, good try right?
- mikeash 13y agoThanks for your correction. Oh wait, you didn't correct anything! Do you really think that if I had called it AArch64 throughout instead of ARM64, I wouldn't have written... whatever it is you're offended by in terms of conflating various parts? You're nuts!
- Pxtl 13y agoThe bit about memory-mapped files, considering the fact that these devices aren't using magnetic discs, is something interesting. The conventional file API of seeking and streams suddenly feels a bit anachronistic. Of course, flash memory is often optimized for sequential reads, but still - it's far more amenable to the memory-mapped model than magnetic media ever was.
- Peaker 13y agoMemory mapped files have a problem (that may be less relevant for iOS) with error reporting. Explicit APIs can have explicit error codes. Memory accesses don't have much opportunity to report errors, so have to resort to awful signals and such (that nobody handles properly).
- mikeash 13y agoApple's NSData API even has a flag just for this, NSDataReadingMappedIfSafe. Basically, it uses memory mapping if the file is on the root filesystem, and otherwise just reads it all in conventionally. This is because if you end up memory mapping a file on a USB stick and the user yanks it, you'll segfault, and nobody likes a crashing app. On the subject of memory mapping and magnetic disks, one amusing bit of history is that GNU's Hurd kernel originally implemented filesystems by memory mapping the entire hard drive and working from there. This worked fine at first, but started to cause major trouble when HDs grew beyond 4GB and Hurd was still running on 32-bit CPUs. I believe they ended up redoing it all without memory mapping so they could grow beyond that limit.
- skylan_q 13y agoThank you for the breakdown of how performance is affected with the new architecture. I've had a few quibbles about where performance gains would be, and all too often I was told that the performance increases would be solely realized in the larger memory addressing space. That just didn't seem right to me. I really like the use of the otherwise unused space in the 64-bit pointers.
- mullr 13y agoIt never occurred to me that they'd be using tagged pointers for Objective-C runtime stuff. Of course it's obviously a good idea, but only after hearing it does it become so. Objective-C is always more dynamic than you think it is, so taking implementation cues from other dynamic language runtimes makes perfect sense. It appears that they've been using tagged pointers on the desktop since 10.7, which I never realized: http://objectivistc.tumblr.com/post/7872364181/tagged-pointers-and-fast-pathed-cfnumber-integers-in http://objectivistc.tumblr.com/post/7872364181/tagged-pointe...
- roskilli 13y agoThis was one of the most interesting things the post detailed for myself, makes so much sense - we do a substantial amount of allocs and reads for NSDecimalNumbers, etc in our payment based app and I can imagine the heap savings and mem write/read savings we will get as a result would of some significance. Pretty interesting innovation.
- mritun 13y agoTagged pointers have been in use since late 60s in most garbage collected languages of the day.
- jeltz 13y agoI was surprised they did not use them already since tagged pointers is an ancient idea implemented in many languages. I guess they might not have been useful enough in ObjectiveC for 32 bit architectures.
- rsynnott 13y agoThey already use them in 64bit Objective C on the desktop.
- wiredfool 13y agoIt's a good idea that caused a world of hurt in the 24 bit to 32 bit transition. There were some macs that didn't have 32 bit clean roms, because they doing things with the pointers that would never have to reference more than 4 megs of ram. Interesting that Apple now has the coordination and control to make it a non nightmare thing now.
- thepumpkin1979 13y ago"On ARM64, 19 bits of the isa field go to holding the object's reference count inline." That's really awesome.
- matthewmacleod 13y agoGreat write-up, thanks! I expect we'll see ARMv8 architectures in the next round of flagship phones. Apple's a little ahead of the curve, but it won't be long till competitors catch up. In the context of Apple, it's interesting to think about how they're going to take this next. ARM process and architecture improvements are likely to lead to chips with high-enough performance to be used in mainstream desktop applications – Is it possible we're going to see something like an ARM/x86 dual-processor Macbook platform that allows ARM's low power consumption supplement Intel's performance?
- glasshead969 13y agoMacs with ARM processors don't seem like a possibility. Intel Haswell processors are shown to have comparable Performance per watt which is expected to get better with Broadwell. ARM64 Apple chips are play for iPads. Current iPads are lagging on performance when we compare it to something like a Baytrail Intel tablet or a Haswell equipped surface tablet. There is going to be convergence point for Intel where a tablet with Haswell level performance with a Fanless chasis and 500$ price. Apple need to converge there to compete.
- Tuna-Fish 13y agoThis is a reasonable, short overview of the programmer-visible side of changes in A64. For those interested, there's an another side. A64 drops all the features of the ISA (inline variable shifts, conditional execution, variable-width instructions) that are hard to implement in a fast, high-power CPU. If a cpu is to not have any 32-bit ARM compatibility, there's no reason one couldn't make a 4GHz 4-wide superscalar one based on A64.
- btian 13y agoThere is one - power consumption.
- Tuna-Fish 13y agoWell yes, it won't fit on a phone. The point was that making a CPU that rivals current desktop cpus is possible using A64, so long as you are willing to expand your power budget to meet them.
- justincormack 13y agoYes its interesting to see a really new ISA, much newer than the old high end contenders like Sparc and Power.
- ajross 13y agoThis is true, but that last sentence is a doozy. The AArch64 ISA drops that stuff. The A7 CPU, which much remain compatible with legacy code, must not. So yes, a theoretical CPU would have a much easier design task, but in the real world we'll never see one. And in any case: there's another reasonably well-known company out there with an even cruftier ISA making 4+GHz 6-wide superscalar cores with backwards 32 (and 16!) bit compatibility modes. Instruction decode is the sort of thing programmers understand, so we tend to get hung up on it when talking about CPUs. It's really not a meaningful design limitation to a CPU core implemented with hundreds of millions of transistors.
- protomyth 13y agoI'm not so sure we won't see a AArch64 only version. A server version would be fine with dropping the 32-bit part.
- bnolsen 13y agoOnly using 33 bits for memory addressing is troublesome. 33 bits is 8GB ram which is small potatos for a desktop. Why couldn't they have left it at 38 or even 40 bits? Or is this limitation only part of the objective-c runtime?
- mikeash 13y agoIt comes down to the OS. Basically, when a new process is created, the OS sets up its address space and decides where it will allow new memory to be mapped. For whatever reason (I'm not entirely clear just yet), iOS 7 in 64-bit mode goes for an 8GB address space. As far as I know, there's nothing preventing that from being increased on future hardware or even on the 5S with future OS updates. I believe the CPU itself supports a 48-bit virtual address space.
- simscitizen 13y agoOne of the biggest impacts of moving to 64-bit is increased memory pressure. While all of Apple's apps and daemons are running 64-bit, most users will be actively using third party apps that are 32-bit-only for a while. This means that on average there is less memory available in the system, because the amount of RAM is unchanged in the 5s, and there will now be code from both 64-bit and 32-bit binaries resident, rather than just 32-bit binaries. Apple has done some work to alleviate this extra memory pressure at the kernel level. grep for WKdm in the xnu sources if you're interested.
- devx 13y agoWhy didn't ARM call it ARM64? It's hard to believe it didn't cross their minds and decided AArch64 is the better name, so it could be another reason.
- duskwuff 13y agoThe "ARM123" naming scheme was used to refer to specific ARM cores prior to the "Cortex" naming scheme. While "ARM64" isn't ambiguous in and of itself, it's troublingly close to ARM60, the first ARM CPU with a 32-bit address space.
- StephenFalken 13y agoIt is interesting to watch ARM finally adopting many of the great architectural solutions that MIPS used 22 years ago, back in 1991, when it launched the MIPS R4000 family of 64 bit processors. [1] [1] http://groups.csail.mit.edu/cag/raw/documents/R4400_Uman_book_Ed2.pdf http://groups.csail.mit.edu/cag/raw/documents/R4400_Uman_boo...
- bodyfour 13y agoThe original ARM ISA felt very VAX-inspired to me, such as the elegant (but ultimately inefficient) use of a general-purpose register for the program counter. I've only just started looking at AArch64 but I agree that it feels a lot more like MIPS though. I think that's a good thing.
- denim_chicken 13y agoI still wonder why in the world Apple went with just 1GB of RAM on the 5s. Even the Nexus 4 that I bought contract-free for $200 comes has 2GB of RAM.
- runjake 13y ago1) Because the iPhone doesn't need 2 GB RAM. 2) They took the money they saved and devoted it elsewhere (perhaps the Sapphire home button? :) When it comes down to the bill of materials, every cent really does count when it scales across several million units sold.
- pslam 13y ago2GB of DDR also takes twice as much power to keep alive vs 1GB of DDR. If you don't need it - it's a waste of battery.
- deleted 13y ago[deleted]
- denim_chicken 13y agoThe iPhone doesn't need a 64-bit desktop-class processor, either. I personally think Apple strategically held off the RAM upgrade 'til next year's iPhone, so that they could have a "killer feature" to lean on if they don't manage to figure out a more novel^Winnovative one in time.
- melange 13y agoAre you seriously claiming that Apple kept the RAM below 1GB so that "Now has >1GB' could be their headline feature for next year?
- denim_chicken 13y agoYes. What's wrong with the idea?
- w-m 13y ago> With ARM64, there are 32 integer registers, with a dedicated zero register, link register, and frame pointer register. One further register is reserved for the platform, leaving 28 general purpose integer registers. but http://www.arm.com/files/downloads/ARMv8_Architecture.pdf http://www.arm.com/files/downloads/ARMv8_Architecture.pdf says: 31 general purpose registers accessible at all times * Improved performance and energy * General purpose registers are 64-bits wide * No banking of general purpose registers * Stack pointer is not a general purpose register * PC is not a general purpose register * Additional dedicated zero register available for most instructions Which one is it? By the way, the ARMv8 resources are quite interesting overall and a bit more in-depth than the article. http://www.arm.com/products/processors/armv8-architecture.php?tab=ARMv8+Resources http://www.arm.com/products/processors/armv8-architecture.ph...
- mikeash 13y agoI'm not seeing the conflict between what I wrote and your quote from the architecture docs. Is it just confusion because the dedicated link register, frame pointer, and platform-reserved register are part of the ABI rather than the ISA?
- Scaevolus 13y agoThere is no dedicated frame pointer-- that would be part of the ABI. The stack pointer and zero register are both encoded as register 31, and the meaning depends on context.
- mikeash 13y agoMy statement encompasses both the ISA and the ABI, which I hope was implied by my previous comment.... From the perspective of a userland software writer, there's not much point in trying to distinguish between the two.
- saurik 13y agoIs the frame pointer register really "dedicated" by the compiler? (I haven't had the time to upgrade everything I need to upgrade yet to install the new Xcode and check this directly.) With 32-bit ARM, there is a register denoted "fp", but with iOS 2.0 Apple started compiling without a dedicated frame pointer (instead using that register temporarily for some kind of thread-local storage variable, before moving that elsewhere and freeing up the register entirely). I was under the impression that dedicated frame pointers are only used when you have less-than-awesome compilers that are unable to keep track of the moving stack pointer target as it performs optimizations.
- Scaevolus 13y agoI hope by "Perform an atomic store of the new isa value." he means "Perform an atomic compare-and-set of the new isa value." A64 doesn't eliminate conditional execution completely. It just pares it down to the basics: branch (obviously), add/sub, select, compare (for flattening conditionals like `a && b && c`). Another thing removed from A32 was the optional shift on operand 2-- which was taking up 7/32 bits for most instructions. This has a few more that were missed: http://nominolo.blogspot.com/2012/07/arms-new-64-bit-instruction-set.html http://nominolo.blogspot.com/2012/07/arms-new-64-bit-instruc...
- mikeash 13y agoIt's not a compare-and-set. Rather, it uses ARM's atomic instructions where the load creates a reservation on the memory address, and the store succeeds only if the reservation is still present, with any other stores to that address (or nearby addresses) breaking the reservation. You can use this pattern to implement compare-and-set, but you don't need compare-and-set to use that pattern directly. Edit: I wasn't sure how to encode this into the steps in the article, so it's a bit vague on that part. Suggestions welcome.
- scott_s 13y agoAlso commonly called load-link, store-conditional: http://en.wikipedia.org/wiki/Load-link/store-conditional http://en.wikipedia.org/wiki/Load-link/store-conditional
- revelation 13y agoCPython has reference counts as a part of the object in memory. The claims of "large memory consumption" are nonsense, especially since small integer objects and strings are aggressively interned. And increasing just one aligned integer is certainly cheaper than the bit masking the solution here entails (all of which is neatly hidden away in the 'increment of the correct portion' part).
- mikeash 13y agoRemember that this decision was made back when the entire system might have 32MB of RAM. Does CPython even fit in that, as a single process, let alone a full multitasking UNIX? Additional RAM consumption has costs of its own, in terms of cache usage. Adding an extra 8 bytes for every object in the system is not insignificant. Masking and shifting is extremely cheap. If you've run the benchmarks and can show your approach is better, by all means, please share.
- mistercow 13y ago>This allows compiling if statements and similar without requiring branching. Intended to increase performance, it must have been causing more trouble than it was worth, as ARM64 eliminates conditional execution. Probably because so many projects use Thumb (the default for iOS projects in XCode, for example) which doesn't include most instructions for conditional execution. From what I can tell, it also sounds like compilers weren't making very effective use of those instructions anyway. Also, these were originally meant to compensate for a lack of branch prediction, which as I understand it, has changed drastically in recent years.
- nickhalfasleep 13y agoAnybody know when 64-bit arm processors might be released as a blade or mini-server to work with?
- Moto7451 13y agoNot sure what the pricing will be like, but AMD is aiming to release their Cortex A57 based CPUs in 2014[1]. [1]http://techreport.com/news/25338/new-amd-embedded-roadmap-shows-64-bit-arm-cortex-a57-chip http://techreport.com/news/25338/new-amd-embedded-roadmap-sh...
- jswanson 13y agoFrom the article: The biggest change is an inline retain count, which eliminates the need to perform a costly hash table lookup for retain and release operations in the common case. Since those operations are so common in most Objective-C code, this is a big win.