5 ms·
You know, we are dealing with people and people think differently so they won't move altogether. Moving to a new company under Alt is not an easy choice, at lea
by azurezyq 3y ago
You know, we are dealing with people and people think differently so they won't move altogether. Moving to a new company under Alt is not an easy choice, at least the new company:
- Does not yet have a big model (need $$$ and months to train, if code is ready)
- Does not have proprietary code OpenAI has right now
- Does not have labeled data ($$$ and time) and chatgpt logs
- Does not have ChatGpt brand...
- bufferoverflow 3y agoI thought GPT-4 was not trained on labeled data, but simply on a large volume of text / code. Most of it is publicly accessible: wikipedia, archives of scientific articles, books, github, plus probably purchased data from text-heavy sites like Reddit.
- enigmurl 3y agoAssuming it's a reference to RLHF? Not sure
- lyu07282 3y agoNo it's reinforcement learning with human feedback, RLHF lots of labeling
- frabcus 3y agoWhatever they've built this year presumably uses all the positive/negative feedback on ChatGPT that they have a year worth of data now... Another examples is the Be My Eyes data - presumably the vision part of GPT-4 was trained on the archive of data the blind assistance app has, and that could be an exclusive deal with OpenAI.