3 ms·

Thank you! The OpenLibrary dataset has ~28M records, takes up 6.8GB on disk and 14.3GB in RAM when indexed in Typesense. Each node has 4vCPUs. Took me ~3 hours

by jabo 6y ago

Thank you! The OpenLibrary dataset has ~28M records, takes up 6.8GB on disk and 14.3GB in RAM when indexed in Typesense. Each node has 4vCPUs. Took me ~3 hours to index these 28M records. Could have probably been done in ~1.5hrs - most of the indexing time was because of cross-region latency between the 3 geo-distributed nodes in Oregon, Mumbai and Frankfurt.

tmikaeld 6y ago
That's a lot of text to index, impressive! Is the indexed size 6.8GB or 14.3GB?
- jabo 6y ago
  Thank you! The indexed size is 14.3GB.