23 ms·

Yep. We’re in a situation where C-like languages couple layout and access interface very tightly. But, now cache is such an overriding issue in optimization, yo

Yep. We’re in a situation where C-like languages couple layout and access interface very tightly. But, now cache is such an overriding issue in optimization, you really want to rapidly experiment with different layouts without rewriting your whole algorithm every time. AOS, SOA, AOSOA, hot/cold data for different stages, etc… Jon Blow’s Jai language famously added a feature to references that allowed you to easily experiment with moving data members between hot/cold arrays of structs. https://halide-lang.org/ https://halide-lang.org/ tackles a related problem. It decouples the math to be done from the access order so as to allow you to rapidly test looping over data in complicated ways to achieve cache-friendly access patterns for your specific hardware target without rewriting your whole core loop every time. Halide is primarily an about image processing convolution kernels. I’m not sure how general purpose it can get.

tialaramex 1y ago
AIUI Jai no longer has that SOA versus AOS functionality which Jon was very proud of when he invented it, I expect it's one of those "hot idea" things where for one week it seems as though this is a breakthrough with applications everywhere and then a week later you realise it was not as fundamental and you were just seeing applications everywhere due to recency illusion. The week after I first saw a Bloom Filter I imagined lots of places this would surely be great, in the decades since I probably have one bona fide use for a Bloom Filter per year, maybe less.
- monkeyelite 1y ago
  Exactly. The SOA thing makes sense in so few cases - usually the one big data type your program operates on.
jayd16 1y ago
I suppose something like this would be considered a violation of OOO... That said Java might be able to naturally decompose record types into SoA collections without a big lift. Same for C# struct. You might even be able to access views types that still code like objects but point to the backing fields in the SoA collection.

tialaramex 1y ago

AIUI Jai no longer has that SOA versus AOS functionality which Jon was very proud of when he invented it, I expect it's one of those "hot idea" things where for one week it seems as though this is a breakthrough with applications everywhere and then a week later you realise it was not as fundamental and you were just seeing applications everywhere due to recency illusion. The week after I first saw a Bloom Filter I imagined lots of places this would surely be great, in the decades since I probably have one bona fide use for a Bloom Filter per year, maybe less.

monkeyelite 1y ago
Exactly. The SOA thing makes sense in so few cases - usually the one big data type your program operates on.

jayd16 1y ago

I suppose something like this would be considered a violation of OOO... That said Java might be able to naturally decompose record types into SoA collections without a big lift. Same for C# struct. You might even be able to access views types that still code like objects but point to the backing fields in the SoA collection.