3 ms·
I can't answer for NVIDIA but AWS has its own training and inference chips, and word on the street is the inference chips are too weak, so some companies are ru
by electroly 6mo ago
I can't answer for NVIDIA but AWS has its own training and inference chips, and word on the street is the inference chips are too weak, so some companies are running inference on the training chips.
- otterley 6mo agoThey stopped producing Inferentia altogether and are only investing in Trainium now. They also announced a partnership with Cerebras not long ago. That should give you a clue. https://www.cerebras.ai/press-release/awscollaboration https://www.cerebras.ai/press-release/awscollaboration