3 ms·
> The primary reason for making chips this big at present, is to compute LLMs. It also makes a lot of sense for HPC, simulation, and other workloads that have
by rbanffy 1y ago
> The primary reason for making chips this big at present, is to compute LLMs.
It also makes a lot of sense for HPC, simulation, and other workloads that have low data locality - this enables much faster point-to-point communication than a rack full of accelerators connected via copper cables would allow. The aggregate bandwidth of the interposer is enormous compared to NICs and latencies are much lower.
> For example, when Von Neumann got ahold of the ENIAC, he slowed it down by more than 60%.
We'll need to rewrite a lot of software for that.