5 ms·
If ChatGPT is trained on the data and ChatGPT is accessible to the general public, then the data may as well be accessible to the general public
by brundolf 4y ago
If ChatGPT is trained on the data and ChatGPT is accessible to the general public, then the data may as well be accessible to the general public
- sterlind 4y agoit seems unlikely to me that ChatGPT is directly trained on chat data. if it is, we should see it know information past its knowledge cutoff. afaik that hasn't happened. I assume the chat logs are instead training a reward model, which itself is then used as the reward function during RLHF training.
- bigyikes 4y agoThese models have a very long lead time before they’re released to the public. Maybe GPT-5 is being trained on ChatGPT logs. I’m not sure we’d be able to detect if this was happening.