You might get some inspiration from Strigi, a C++ library and program that also does recursive decompression for searching. It support indexing pdfs, archives,

You might get some inspiration from Strigi, a C++ library and program that also does recursive decompression for searching. It support indexing pdfs, archives, emails without writing temporary files. https://www.vandenoever.info/software/strigi/akademy2006.pdf https://www.vandenoever.info/software/strigi/akademy2006.pdf I've considered rewriting Strigi in rust quite often but too many other projects to pursue at the moment.