4 ms·
> One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw. Do you have
by m00x 4y ago
> One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw.
Do you have a source for that? I've implemented GPT from scratch and I don't see anywhere that doesn't just take the current output + input as attention and produces the next word. The loss being if it correctly guessed what would be the next word according to context and position.
- randomdata 4y agoThere were some papers linked here yesterday. I'm not good at memorizing URLs. Sorry.
- fiso64 4y agoChatGPT was also trained with reinforcement learning to produce outputs human raters preferred
- m00x 4y agoIt's definitely getting closer in this case, but still chatGPT still look for any truth in its response.