3 ms·

Thanks for your work! I had already downloaded the entire dataset. But I wonder what was the criteria behind book selection? I found it difficult to understand

by yyyk 3y ago

Thanks for your work! I had already downloaded the entire dataset. But I wonder what was the criteria behind book selection? I found it difficult to understand at places*. * Sometimes a book has several very slightly different versions. A lot of Fantasy. Sometimes many parts of a series are included but not all of it (I can imagine an argument for a sample, or for the series in its entirity). Commentaries about important philosophical arguments like Rawls' 'A theory of justice', but not the work itself.

sillysaurusx 3y ago
It was bibliotik. Embarrassingly I didn’t even think that duplicate books could be a problem. The llama folks had to dedupe the books themselves. Someday I’d like to do that too and release a cleaned version. Basically, the-eye.eu was at one point hosting all of bibliotik, so I downloaded all the epubs and converted them to text. I still have those epubs (incidentally thanks to Carmack, who through a convoluted process managed to save the them and send them to me via snail mail) and I’ve been considering releasing them so that you can filter the books yourself.