3 ms·
Rumor is that google will be deploying an 8 billion parameter version of lamda for their competitor, compared to the 176 Billion parameters used for GPT3.5. If
by Jackson__ 4y ago
Rumor is that google will be deploying an 8 billion parameter version of lamda for their competitor, compared to the 176 Billion parameters used for GPT3.5.
If that holds true, they might have already fatally fumbled the execution.
- pphysch 4y agoIf it means average latency is 100ms instead of 1s or whatever the huge GPT model can currently serve to millions of content users, that matters a lot for search.