3 ms·
This gets back to the example in the blog post. GPUs can run anything, but if the code spends any appreciable time communicating between threads the performance
by wmf 7y ago
This gets back to the example in the blog post. GPUs can run anything, but if the code spends any appreciable time communicating between threads the performance of a GPU will tank because the individual "cores" are quite slow.
- zozbot234 7y agoI don't think it's that simple - you could easily communicate across "threads" in a warp, since these are just SIMD execution units. And you could use GPU main memory to communicate across true "streaming" processors, with some minimum latency. The troubling case is when communication latency limits performance, and the communication is not tightly-coupled within something like a warp. That's when CPU's (or even more exotic models, like systolic arrays etc.) might be preferable.
- lostmsu 7y agoI think the most important part is not communication, but control flow dependencies on data.