2 ms·
I worked on a large distributed machine learning pipeline. We used software prefetch via Intel instructions- the training algorithm knew that it would be opera
by dekhn 8y ago
I worked on a large distributed machine learning pipeline. We used software prefetch via Intel instructions- the training algorithm knew that it would be operation on a bunch of examples in the memoryspace surrounding a fetched item, so it explicitly specified prefetech.
It was really hard to measure speedups; they would work fine if the code ran on an otherwise idle machine and had ample spare resources. But if another code ran on the machine and was hosing L2, the prefetch quickly caused performance to drop.
In retrospect, explicitly bundled data and explicit (software) prefetch worked more reliably under most scenarios.