3 ms·
Have You Tried AWS Inferentia2 for ML Deployments?
- agcat 3y agoAWS claims that Inferentia2 chip delivers 4x throughput increase and a 10x latency reduction compared to Inferentia. Have you tried the offering? Would like to hear your experience