3 ms·
(I don't work at OpenAI so take it with a grain of salt) Yes and No they are similar. It is basically just a fancy autocomplete like llama, but I believe it's s
by thot_experiment 4y ago
(I don't work at OpenAI so take it with a grain of salt) Yes and No they are similar. It is basically just a fancy autocomplete like llama, but I believe it's specifically been trained on chat content, or at least finetuned on such, and it probably uses a more chat focused labeling scheme on the training data as well to help it perform well on that specific task and be conversational.
- tarruda 4y agoTo me it is really mind blowing that these properties (coding, emulate chatbot) emerge from just from feeding these neural nets with text data. Thanks for the info.