3 ms·
Hey eis, you are correct. We do not support index storage in our latest release. I am currently implementing this, and it is in a fairly advanced stage. So it s
by pholanda 4y ago
Hey eis, you are correct. We do not support index storage in our latest release.
I am currently implementing this, and it is in a fairly advanced stage. So it should be featured in the next release.
This took a little while because we use a fairly modern index structure with no literature definition on how to buffer manage it.
- eis 4y agoIt's good to hear that persistent indexes are coming soon. I saw it was on the roadmap but didn't know how far out this feature was. Do you have an idea when that release could be out? BTW Do you have some kind of code/docs one can take a look at regarding the index structure? I'm a part-time data structure nerd :)
- 1egg0myegg0 4y agoHere is a paper that was used when building the DuckDB approach! https://db.in.tum.de/~leis/papers/ART.pdf https://db.in.tum.de/~leis/papers/ART.pdf There are some other papers and details about the architecture here: https://duckdb.org/why_duckdb https://duckdb.org/why_duckdb
- nojvek 4y agoWill the persistent indices still be built on ART indexes? ART is a great choice of data structure. Fast lookups, range queries and prefix queries. Typesense DB (Typesense.org) under the hood also uses ART as the base datastructure for fast full text search queries. So I assume it would be straightforward to build an text search engine on top of duck DB and utilize ART indices to do even more lovely things.