6 ms·
This isn't an informed article. Reference counting is a type of garbage collection. It's not complete without collecting cycles, but it can form part of a GC m
by barrkel 10y ago
This isn't an informed article.
Reference counting is a type of garbage collection. It's not complete without collecting cycles, but it can form part of a GC mix.
Assigning pointers in a scanning GC can have a cost; for example, generational GCs need to track writes to old generations that point to newer generation objects.
There's no discussion of thread safety and how that affects reference counting. That's probably the biggest problem; you need to use memory barriers to make reference counting safe with multiple threads, and that can kill performance.
- vardump 10y agoYou don't necessarily need memory barriers (implementation detail). All you need is an atomic fetch-and-add (like x86 XADD opcode). Many architectures provide that as a primitive. On those that don't, you have to compose it out of other atomic primitives.
- xxs 10y agoAtomic part has to notify the rest of caches to invalidate the cache line. Local latency in the best case.
- gpderetta 10y agoFYI, any store has to invalidate remote cachelines, that's taken care by the coherence protocol even before the store is actually performed. Memory barrier (and atomic operations) don't have anything to do with it.
- JoachimSchipper 10y agoWhether stores invalidate remote cachelines depends entirely on the architecture. But yes, Intel has fairly strong coherency.
- gpderetta 10y agoIt seems to me that any cache coherent system needs to do that. If multiple writers can be updating a cacheline a the same time [1] you can't talk of coherency at all. Intel is stronger as it guarantees a total ordering of modifications across all cachelines, but any coherent system will guarantee the ordering of modification of a single cacheline. [1] visibly at least. HTM complicates things a bit of course.
- imtringued 10y agoSo false sharing is the problem?
- gpderetta 10y agoIf the refcount is allocated in the same cacheline with the rest of the object, then false sharing is also a problem. But the violation of the single writer principle when updating refcounts is actually a form of true sharing.
- deleted 10y ago[deleted]
- gpderetta 10y agoif you have destructors or finalizers you do need memory barriers to make sure that any previous modification of the object happens-before the destructor is run. Also many architectures with builtin fetch-and-add bundle it with an implicit memory barrier (that includes x86).
- vardump 10y agoBut then those barriers are not for the refcount itself, but for the data the object contains. Different things. On x86, stores are always ordered anyways, so fetch-and-add doesn't need to do any implicit memory barrier.
- gpderetta 10y agoBarriers are never needed for accesses to a single location as all practical systems guarantee total ordering, that a given. But on a refcounted system the only place to put the barrier for correct visibility, it is together with the refcount update. It is true that on x86 all stores and loads have the correct implicit barriers, but you still get a store-load (including its cycle cost) with lock xadd whether you want it or not.
- barrkel 10y agoI think you need more than just fetch-and-add. Think about this: assign(value) { root.ref = value; } needs to be expanded out into: assign(value) { if (value) inc_ref(value) tmp = value atomic_swap(&root.ref, &tmp) if (tmp && dec_ref(tmp) == 0) free(tmp) } If you don't use an atomic swap, you race with other threads trying to assign to the same location. You can't decrement the destination before incrementing the source because they could be equal. You can't make the logic conditional on equality because it races. You have a harder time with this: a.b.c = value You need to inc-ref each step in the chain, keeping them in temporaries, to ensure they don't get dec-refed out from underneath you on another thread.
- vardump 10y agoBut if you have both atomic primitives available, why would you ever do that? Keyword is atomic. Fetch-and-add returns you the previous value atomically. ------- Edit: This (below) is obviously a buggy reference counting algorithm. ------- In freeing (decrementing reference count) thread A, if it was 1 before (returned value) and A added -1, the object can be freed. Because the operation is atomic, only one of two things can happen: 1) Another reference adding thread B increments it before A decreases it. So A doesn't see 1, thus won't free the object. 2) B increments it after A decremented it. So B gets zero and knows the object is invalid. (Edit: Oops, a bug: after B increments refcount, when thread C tries to do same, it would get 1 and conclude the object is valid!) If B is allowed to allocate the object again (invalid state, refcount == 0), careful synchronization needs to be done remove any races with A's deallocation.
- barrkel 10y agoI think you're hung up on multiple threads reference-counting a single instance. That's not where reference counting as a GC approach gets difficult. It's when you're updating references to values.
- chrismonsanto 10y agoThe reference counting != GC thing gets repeated all the time on HN, so I'm glad you called this out. For the record, what these people call "GC" is better called tracing garbage collection.
- EdiX 10y agoI think the "reference counting != GC" meme originates in Apple's marketing, specifically they needed a simple way to market their reference counting (which they call ARC to distinguish it from manual reference counting previously used by ObjC) as different and superior to Android garbage collection.
- pjmlp 10y agoAnd also to hide the fact that their Objective-C GC attempt was a failure. It is true that their ARC semantics is a better solution to Objective-C's memory management semantics, but they needed to do the typical marketing stunt of selling a failure as something positive.
- jasode 10y agoIt's not just HN. It's also differentiated that way in the official Apple documentation. I previously commented on it: https://news.ycombinator.com/item?id=7866732 https://news.ycombinator.com/item?id=7866732 The "rc != gc" ship has already sailed. I realize that it can be annoying to language purists but the way to make peace with it is to separate discussions into 2 types of contexts: 1) formal computer science discussion (such as Lambda The Ultimate) --> "rc == gc" 2) real-world discussions in Apple documentation and various other forums --> "rc != gc" I'm not prescribing that you must like the situation but merely pointing out that's how it is these days. Repeatedly making corrections in the hopes that #1 overtakes #2 is not going to sway common usage. Even rigid and exacting computer scientists use words and concepts[1] that mathematicians frown on. In the end, the common usage (that often strays from original precision) prevails. [1]e.g. "integer" as -32k to +32k instead of -inf to +inf, and "=" as "assignment" instead of "equality"
- 10y ago
- mortoray 10y agoI (author) actually agree that reference counting is a form of garbage collection. However, in most dicussions about memory management the generic term garbage collection tends to refer to scanning collectors. In particualr, people who often oppose my views on scanning GCs are the ones that actually use the term garbage collector to refer to those types of collectors. Most places I see talking about reference counting just say reference counting, sometimes mentioning memory management. Automatic memory management is perhaps the most generic term. How reference counting actually works is covered in my previous article, which I wrote as a lead-up to this one. It covers the particulars of how memroy coherency is the primary cost of reference counting.
- michaelfeathers 10y agoThere is a lot of data on this topic. This is a good starting place: http://www.amazon.com/Garbage-Collection-Algorithms-Automatic-Management/dp/0471941484 http://www.amazon.com/Garbage-Collection-Algorithms-Automati...
- pjmlp 10y agoAnother thing is the usual issue that tends to get omitted, how GC enabled languages like Modula-3, Oberon(-2), D among others, do allow for a finer control of the GC. In Modula-3, I can either fully rely on the GC, do safe global and stack allocations, or if really needed make use of manual memory management in unsafe modules. So it is not as all allocations need to be on the GC heap, in GC enabled languages.
- rubber_duck 10y agoI'm not sure about the others but the D model is probably the worst of both worlds - you can transparently store a GC allocated reference in to unmanaged heap and risk having dangling pointers after a random collection or you have to root everything you allocate increasing the scan. Something like Rust has a type system powerful enough to track such things so if you added GC to Rust you could deal with it sanely.
- pjmlp 10y agoD suffers from not having a good GC implementation in first place. There is someone improving it with this year during a GSoC project.
- rubber_duck 10y agoThis is true as well but at least that part is fixable (although I'm not sure it's in the realm of a GSoC project considering the kind of work that went in to stuff like various JVM GC implementations)
- pjmlp 10y agoThey are mainly making it precise as stepping stone for further improvements. https://summerofcode.withgoogle.com/projects/#6205597829562368 https://summerofcode.withgoogle.com/projects/#62055978295623...
- beefsack 10y agoWhat about RC boxes[1] in Rust? I believe they're correctly freed but not as part of explicit collecting cycles. [1]: https://doc.rust-lang.org/std/rc/ https://doc.rust-lang.org/std/rc/
- barrkel 10y agoRc boxes in Rust are not safe against cycles. That's not a memory safety error - i.e. it won't permit use-after-free - but it can be a potential memory leak.