5 ms·
I don't think it's that simple - you could easily communicate across "threads" in a warp, since these are just SIMD execution units. And you could use GPU main
by zozbot234 7y ago
I don't think it's that simple - you could easily communicate across "threads" in a warp, since these are just SIMD execution units. And you could use GPU main memory to communicate across true "streaming" processors, with some minimum latency. The troubling case is when communication latency limits performance, and the communication is not tightly-coupled within something like a warp. That's when CPU's (or even more exotic models, like systolic arrays etc.) might be preferable.
- lostmsu 7y agoI think the most important part is not communication, but control flow dependencies on data.