If you add the chat/conversational features on top (there are countless tutorials for that, one is included with langchain and others extended that one), the ‘v

If you add the chat/conversational features on top (there are countless tutorials for that, one is included with langchain and others extended that one), the ‘very cheap’ goes out the window fast. For it to have memory, people use clever summarizing and embeddings, however, you end up sending 1000s of tokens every time you interact. To get gpt3 to create similar long winded responses, you have use tricks which also cost a lot of tokens. Out of the box, gpt3 feels miles away from chatgpt when you try things naively (which chatgpt happily answers, while gpt3 probably will just repeat you or write nonsense). So the ‘raw’ you start with is correct; once you are happy with the results, the cheap is out the window.