3 ms·
CPU-adjacent ML compute power. Today, models are trained on massive GPUs that live very far away from CPUs (microseconds). This means the models end up having
by brrrrrm 4y ago
CPU-adjacent ML compute power.
Today, models are trained on massive GPUs that live very far away from CPUs (microseconds). This means the models end up having extremely predictable workloads (dense linear algebra). If CPUs were closer to that much compute, you could efficiently execute substantially more dynamic work. Apple and Intel are both getting there with AMX coprocessors (that live only nanoseconds away).
- boppo1 4y agoWhere/how can I keep an eye on this? Also, as someone getting into C++ for graphics programming, what should I add to my curriculum?