4 ms·
https://www.offlineos.com/libgen-text.txt https://www.offlineos.com/libgen-text.txt About the missing books fiction and non fiction > if the book is missing (
by BlackLotus89 4y ago
https://www.offlineos.com/libgen-text.txt https://www.offlineos.com/libgen-text.txt
About the missing books fiction and non fiction
> if the book is missing (15%), that means the text could not be extracted.
> if the book is missing (10%), that means the text could not be extracted.
===
| why plain text?
===
- text is smaller (figures are for old .tar.xz, compressed .zip is about double the size)
+----------+------------------------------------+------------------------+
| | size | number of files |
+----------+----------+-------+-----------------+-----------+------------+
| data set | original | text | compressed text | original | text |
+----------+----------+-------+-----------------+-----------+------------+
| lg | 32TB | 0.8TB | 0.32TB | 2,450,000 | 2,220,000 |
+----------+----------+-------+-----------------+-----------+------------+
| ff | 2.4TB | 0.5TB | 0.18TB | 2,180,000 | 1,890,000 |
+----------+----------+-------+-----------------+-----------+------------+
- text can be viewed on every device.
- plain text cannot contain malicious code. pdfs can.
- text can be searched and indexed more easily.
- why csv? anyone can use csv. it can be read raw in a text editor, opened in excel, or imported into a database. database dumps can be used only by experts.
- bhaney 4y agoI don't see how plain text in zip files is any more searchable than epubs (which are each just plaintext-heavy XML files wrapped in a zip file). And PDFs potentially containing malicious code is an argument against using PDF, not an argument for using plaintext specifically. Being viewable on every device is a decent reason, I just don't personally think it's worth the degradation in reading quality. > if the book is missing (15%), that means the text could not be extracted. I saw that, I just don't understand why a book that isn't included has an entry in the CSV file. If the automated tool fails to extract the text from the book to include in the archive, then why put it in the index file?
- djbusby 4y ago> why put it in the index file? So now you have a list of stuff that should have been included but isn't? Then maybe chase down why and fix?