thank you! We solved 3 challenges as described in the blog post. The first one is really gathering metadata of different index files to know in advance where to

thank you! We solved 3 challenges as described in the blog post. The first one is really gathering metadata of different index files to know in advance where to read exactly the index data that will be needed when receiving a query. We call this the "hotcache". The hotcache is specific to quickwit. Then we also modified the index structure so that we only need to make only 3 subsequent queries on the storage to fetch the relevant data for return the matching documents. The index structure is coded in tantivy. Finally, with parallelisation of queries, we get the right throughput from s3. We definetetly need to write a blog post on that and explain what we did in some meetups and confs. PS: it's tantivy not tantivity :)