5 ms·
Google only has a fraction of the training data. OpenAI had a huge head start and has been collecting training data for years now. ChatGPT is also wildly popula
by waselighis 4y ago
Google only has a fraction of the training data. OpenAI had a huge head start and has been collecting training data for years now. ChatGPT is also wildly popular which has given them tons more training data. It's estimated that ChatGPT gained over 100 million users in the first two months alone, and may have over 13 million active users daily.
The logs on ShareGPT are merely a drop in the bucket.
- rocmcd 4y ago> Google only has a fraction of the training data. Uh, what? The same Google that has been crawling, indexing, and letting people search the entire Internet for the last 25 years? They have owned DeepMind for nearly twice as long as OpenAI has been in existence! If anything this is proof that no one at Google can get anything done anymore, and lack of training data ain't the problem.
- mirker 4y agoThe alignment portion of training requires you to have upvote/downvote data on many LLM responses. Google’s attempt at that (at least according to the news so far) was asking all employees to volunteer time ranking the responses. Combined with no historical feedback from ChatGPT, they are behind.