Yes - if the core innovations in ChatGPT hadn't came with the base GPT-3 model, we'd see that too. Just imagine if they had released a model which transformed

Yes - if the core innovations in ChatGPT hadn't came with the base GPT-3 model, we'd see that too. Just imagine if they had released a model which transformed a page of search engine result snippets into the answers ChatGPT gives today, where it'll prefix with "There are many issues to consider" and formulate a complete response combining information. This - reinforcement learning from human feedback - is truly what has changed in ChatGPT vs what came before. And combined with the chat interface - our native way to communicate - that has toppled human imagination into the "pleasant" zone. But if this had been released and needed to be ran for each response first on a page of results, without the underlying giant LLM - we wouldn't be nearly as impressed. A veneer and a person with a dentists gown, don't make a dentist. But the veneer makes the gown palatable.