3 ms·
AI Libstc3 (July 2024) Dataset for training LLMs further
- ImperiumOfMan 2y agoWhat? - More than 600,000 fiction and non-fiction book full-texts - More than 8,000,000 scholarly publications, magazines, and manuals full-texts - More than 5,000,000 US patents - 164,000,000 metadata records Format Zstd compressed file, JSON lines, one per book/publication, 356GB - abstract, content - description and content in markdown format - issued_at - time of issuing of the object (not of the record itself) - metadata - ISBNs, publishers, series etc - id - identifier in external systems, if applicable (i.e. DOI) other fields should be self-descriptive Download magnet:?xt=urn:btih:37504c50e6f318e8fee6e3f82a8150a888a4cdc8&dn=http://libstc3-libstc.cc.jsonl.zst&tr=udp%3A%2F%http://2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%http://2Fopen.demonii.com%3A1337%2Fannounce&tr=udp%3A%2F%http://2Ftracker.torrent.eu.org%3A451%2Fannounce http://libstc3-libstc.cc.jsonl.zst&tr=udp%3A%2F%http://2Ftra...