3 ms·
> Google only has a fraction of the training data. Uh, what? The same Google that has been crawling, indexing, and letting people search the entire Internet fo
by rocmcd 4y ago
> Google only has a fraction of the training data.
Uh, what? The same Google that has been crawling, indexing, and letting people search the entire Internet for the last 25 years? They have owned DeepMind for nearly twice as long as OpenAI has been in existence!
If anything this is proof that no one at Google can get anything done anymore, and lack of training data ain't the problem.
- mirker 4y agoThe alignment portion of training requires you to have upvote/downvote data on many LLM responses. Google’s attempt at that (at least according to the news so far) was asking all employees to volunteer time ranking the responses. Combined with no historical feedback from ChatGPT, they are behind.