4 ms·
This isn't a technical deep dive, but here's a simplified explanation. It's a matrix multiplication (https://en.wikipedia.org/wiki/Matrix_multiplication https:
by ftxbro 3y ago
This isn't a technical deep dive, but here's a simplified explanation.
It's a matrix multiplication (https://en.wikipedia.org/wiki/Matrix_multiplication https://en.wikipedia.org/wiki/Matrix_multiplication) accelerator chip. Matrix multiplication is important for a few reasons. 1) it's the slow part of a lot of AI algorithms, 2) it's a 'high intensity' algorithm (naively n^3 computation vs. n^2 data), 3) it's easily parallelizable, and 4) it's conceptually and computationally simple.
The situation is kind of analogous to FPUs (floating point math co-processor units) when they were first introduced before they were integrated into computers.
There's more to it than this, but that's the basic idea.