3 ms·
If it means average latency is 100ms instead of 1s or whatever the huge GPT model can currently serve to millions of content users, that matters a lot for searc
by pphysch 4y ago
If it means average latency is 100ms instead of 1s or whatever the huge GPT model can currently serve to millions of content users, that matters a lot for search.