3 ms·
A huge proportion of this corpus is found in the Hathi Trust (see https://www.hathitrust.org/the-collection/ https://www.hathitrust.org/the-collection/). We ha
by xipho 2y ago
A huge proportion of this corpus is found in the Hathi Trust (see https://www.hathitrust.org/the-collection/ https://www.hathitrust.org/the-collection/). We have had a grant to crawl and derive an index on it via their supercomputing resources. I'm sure they are looking to LLM proposals, though they are exceedingly careful about the copyright issues.
https://www.hathitrust.org/ https://www.hathitrust.org/
- fredgrott 2y agothank you as some of us were looking for something to replace the archive.org digital book library part....
- jsemrau 2y ago>I'm sure they are looking to LLM proposals Well, it is a use case for this challenge https://www.kaggle.com/competitions/gemini-long-context https://www.kaggle.com/competitions/gemini-long-context