3 ms·
I think they are winning race to run these models cheaper (see drop in Embedding API)and that's the key here. I've heard that Google to run LaMDA for each quer
by machiaweliczny 4y ago
I think they are winning race to run these models cheaper (see drop in Embedding API)and that's the key here.
I've heard that Google to run LaMDA for each query would cost 2x their revenue but if they gonna drop cost by 10x then it's "only" 20% of their revenue and that's probably possible with special hardware / optimizations. So whoever does it first will take over search space.
- visarga 4y agoInteresting, do you have a link? I'd like to read more.
- mathteddybear 4y agoLaMDA consists of several fine-tunings of a single pre-trained model. Each of them generate candidate responses, the candidate responses are scored (using yet another fine-tuning of the model, iirc) and the best is selected. One expects that the version of LaMDA for internal and raters use does not have to be frugal.
- cma 4y ago> drop in Embedding API Any link to what you are talking about here?
- machiaweliczny 4y agoSee 99.8% price reduction - https://openai.com/blog/new-and-improved-embedding-model/ https://openai.com/blog/new-and-improved-embedding-model/