3 ms·
For the previous generation, AWS had a split where Trainium == model training and Inferentia == inference. With the current generation, they are also recommend
by coredog64 1y ago
For the previous generation, AWS had a split where Trainium == model training and Inferentia == inference. With the current generation, they are also recommending smaller Trainium configurations for inference.
Even if nobody trains another model, the Trainium chips will be useful for inference of existing models that have been recompiled for it.