3 ms·
Now what is the limitation? Latency. Our hardware may be getting faster and faster, throughput-wise, but it is certainly not improving very much in the latency
by chongli 12y ago
Now what is the limitation?
Latency. Our hardware may be getting faster and faster, throughput-wise, but it is certainly not improving very much in the latency department. Many of the things we'd like to build (such as AI) tend to have a lot of dependent memory accesses. These sorts of processes are highly sensitive to latency.