4 ms·
I'm not at all an expert in hardware, but I have experience using chiplet-based chips in production and optimizing for them. Those chips are better from a perfo
by kccqzy 4y ago
I'm not at all an expert in hardware, but I have experience using chiplet-based chips in production and optimizing for them. Those chips are better from a performance per $ point of view, but they don't necessarily achieve the highest absolute performance. The main limiting factor appears to be latency for communication between chiplets. If you write anything with shared mutable memory you are affected by this. Simple atomic operations like compare-exchange is much slower if the threads run on different chiplets.
However I fully expect this to be the future. The performance per $ is what really matters to the bean counters, and us software engineers will just have to write better software to work around it, perhaps with something like NUMA-aware scheduling that understands chiplets.
- bee_rider 4y agoI wonder if it would be better to scale down cluster paradigms (MPI stuff), rather than trying to somehow scale up shared-memory paradigms.
- JonChesterfield 4y agoDropping cache coherency is a big lever for performance. That's definitely more annoying to program against than a magically coherent model though.
- bee_rider 4y ago“Big lever” is a nice expression, successfully expresses both the power and unwieldiness of a thing.