3 ms·
It's wafer scale integration. All the major AI learning chips are probably heading this way. That is, CPUs and GPUs are made on silicon wafers, typically 30cm
by Tuna-Fish 7y ago
It's wafer scale integration. All the major AI learning chips are probably heading this way.
That is, CPUs and GPUs are made on silicon wafers, typically 30cm in diameter, with many chips built on a single wafer and then cut from the wafer and packaged into products. The idea of wafer-scale integration is that instead of cutting the wafer, you just build all the communication between the computation elements in the wafer into the wafer and therefore get a "network on wafer", a single very massive "chip".
The reason to do this is that the lowest-energy way to communicate data is on-chip, and in major AI learning setups, by far the most of the power is spent on data movement. By making the largest possible chip, you minimize the data movement power requirements and spare more power for the computation.
- sanxiyn 7y agoWafer scale integration does seem to be a logical conclusion of integrated circuit. When Jack Kilby invented IC it indeed was a stroke of genius.