3 ms·
The difference is the power numbers. 3.5x faster than CPU doesn't sound special, but when you're building inference capacity by the megawatt, you get a lot mor
by bobdole1234 10y ago
The difference is the power numbers.
3.5x faster than CPU doesn't sound special, but when you're building inference capacity by the megawatt, you get a lot more of that 3.5x faster TPU inside that hard power constraint.