3 ms·
One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw. I'm not sure y
by randomdata 4y ago
One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw.
I'm not sure your definition really clears up how reasoning or thinking differ from "basic" statistical processes. Granted, perhaps it is not explainable. If it were we would understand it well enough to replicate it.
- m00x 4y ago> One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw. Do you have a source for that? I've implemented GPT from scratch and I don't see anywhere that doesn't just take the current output + input as attention and produces the next word. The loss being if it correctly guessed what would be the next word according to context and position.
- randomdata 4y agoThere were some papers linked here yesterday. I'm not good at memorizing URLs. Sorry.
- fiso64 4y agoChatGPT was also trained with reinforcement learning to produce outputs human raters preferred
- m00x 4y agoIt's definitely getting closer in this case, but still chatGPT still look for any truth in its response.