4 ms·
> AI models with obvious, broad, real world applications always seem get reproduced in public. Really? GPT-3 was released almost 3 years ago. Where is the publ
by p-e-w 4y ago
> AI models with obvious, broad, real world applications always seem get reproduced in public.
Really? GPT-3 was released almost 3 years ago. Where is the public reproduction?
And don't say LLaMA. I've used it and it isn't even close to GPT-3, nevermind GPT-4.
- spi 4y agoThe current generation of GPT-3, which started with text-davinci-003, was actually released on November 2022, not quite 3 years ago. I'm not even sure the model that was released 3 years ago is still available to test, but it was much less impressive than more recent models - I wouldn't be surprised if LLaMa were actually better.
- GaggiX 4y agoThe model trained 3 years ago was only trained on 300B tokens, heavily undertrained (in terms of the Chinchilla scale), that's why LLaMa models can easily beat it on most benchmarks (they were trained on 1/1.4T tokens). About the current GPT-3.5 models, who knows, OpenAI is not very open about it.
- lee101 4y ago[dead]
- lee101 4y ago[dead]
- valine 4y agoWhich Llama model have you played with? Unless it’s Llama 65B with 16f precision it’s not a fair comparison to gpt3.