3 ms·
Noob Question: Isn't this going to be an great source for training Language models? Is it safe to assume that OpenAI/Google/Meta etc already have these? In any
by itissid 3y ago
Noob Question: Isn't this going to be an great source for training Language models? Is it safe to assume that OpenAI/Google/Meta etc already have these?
In any case great work!
- m00dy 3y agoyes, of course. AA has a special program for llm developers.
- crtasm 3y agoWorldcat is a database of books, not the books themselves. The summary and description text might be useful though?
- mannyv 3y agoIf you could somehow download the entire archive you could feed it into your LLM for training. This is a huge corpus and is sort of ill-gotten. That said, it would be pretty awesome. Google has this sort of thing already, since they have that whole "let's digitize the world's books" project. Interesting as to why google never developed a ChatGPT, given that they literally have a large amount of the world's books digitized.
- crtasm 3y agoGoogle launched Bard earlier this year.