6 ms·
For low-latency strategies, AMD's lack of DDIO [0] makes it a non-starter. The memory latency is a big gap to close. [0] https://www.intel.com/content/www/us/e
by isogon 4y ago
For low-latency strategies, AMD's lack of DDIO [0] makes it a non-starter. The memory latency is a big gap to close.
[0] https://www.intel.com/content/www/us/en/io/data-direct-i-o-technology.html https://www.intel.com/content/www/us/en/io/data-direct-i-o-t...
- b20000 4y agohow do you access this DDIO feature if you are writing a C or C++ application? intrinsics?
- medawsonjr 4y agoIt's configurable via MSR. You can also disable it system-wide or on a PCIe port basis. I detailed it all here: https://www.jabperf.com/skip-the-line-with-intel-ddio/ https://www.jabperf.com/skip-the-line-with-intel-ddio/
- tbr1 4y agoDDIO operates mostly transparently to software, with the I/O controller feeding DMAs into a slice of L3. Hardware can opt out by setting PCIe TLP header hints, and you have some system-wide configurability via MSRs, but it's not something a userspace application can take into its own hands.
- kolbe 4y agoDo you know this for a fact? I've done some work in the industry where I needed to make fast software, but never the like sub-microsecond tick-to-trade type fast, so I really don't know. There was a great presentation from 2017 about some of Optiver's low latency techniques[1]. I had assumed they released it because the had obviated all of them by switching to FPGAs, but I don't know. Either way, he suggested that if you ever needed to ping main memory for anything, you already lost. So, I wouldn't have thought DDIO plays into their thinking much. [1] https://www.youtube.com/watch?v=NH1Tta7purM https://www.youtube.com/watch?v=NH1Tta7purM
- isogon 4y agoThe idea is precisely that you want to avoid pinging main memory at all, which is possible (in the happy case) if you do things correctly with DDIO. Not everything is done in hardware where I am. I am wary of saying much because my employer frowns on it, and admittedly I work on the software more than the hardware, but DDIO is certainly important to us.
- deleted 4y ago[deleted]