2 ms·
Ada is one of the (if not the) worst model offered by OpenAI, though ...
by moralestapia 3y ago
Ada is one of the (if not the) worst model offered by OpenAI, though ...
- simonw 3y agoYou're thinking of the old "ada" GPT-3 model - the one that was a companion to "davinci" and "babbage". I believe "text-embedding-ada-002" is entirely unrelated to those old GPT-3 models. It's a recent embedding model (released in December 2022 - https://openai.com/blog/new-and-improved-embedding-model https://openai.com/blog/new-and-improved-embedding-model ) which OpenAI claim is their best current best available embedding model. I understand your confusion: OpenAI are notoriously bad at naming things!
- moralestapia 3y agoOh, thanks for clarifying! Edit: looking at the press release, the improvement over old Ada is ... marginal? And Ada-01 is/was a poor performing model, tbh. I guess I'll have to run some tests, but at first sight it doesn't seem that wow-ey.
- LASR 3y agoSo just to be super clear, this is an embedding model. It generates no text. It’s not outputting words. Maybe I am assuming incorrectly, but I think the poor performance you are referring to is the old Ada completion model, where the output is text. That was poor indeed.
- itake 3y agoThis article is not kind to the old ada embeddings model: https://medium.com/@nils_reimers/openai-gpt-3-text-embeddings-really-a-new-state-of-the-art-in-dense-text-embeddings-6571fe3ec9d9 https://medium.com/@nils_reimers/openai-gpt-3-text-embedding... If the new ada model only has marginal improvements, it seems open source is way to go.