4 ms·

I saw Jack Dongarra say that plain parallelism is now old and the thing is “communication avoidance”. Also made the point (relevant to your quotation) that chan

I saw Jack Dongarra say that plain parallelism is now old and the thing is “communication avoidance”. Also made the point (relevant to your quotation) that changing hardware means redoing the algorithms every ten years to exploit it.

xiphias2 8y ago
That's a great model that even helps running algorithms on FPGAs. Are there researchers working on finding the theoritical communicication limits of classical numerical problems?
4thaccount 8y ago
As if the algorithms behind numerical methods weren't hard enough, now we have to add parallelism :)