4 ms·
This makes some amount of sense: generative AI is _very_ expensive. But generative is only one class of AI workload; predictive/inference is probably what the
by baby_souffle 3y ago
This makes some amount of sense: generative AI is _very_ expensive.
But generative is only one class of AI workload; predictive/inference is probably what the tensor is used for most. I would not be shocked to find out that the "find object in this photo" part of magic eraser worked on device but the "figure out what to put in picture after object removed" bit is done server side.