4 ms·
AWS claims that Inferentia2 chip delivers 4x throughput increase and a 10x latency reduction compared to Inferentia. Have you tried the offering? Would like to
by agcat 3y ago
AWS claims that Inferentia2 chip delivers 4x throughput increase and a 10x latency reduction compared to Inferentia.
Have you tried the offering? Would like to hear your experience