3 ms·
Pg_bm25: Rust-based full text search engine in Postgres
- retakeming 3y agoHey HN - lead dev on pg_bm25 here. To provide a bit more context: the goal of pg_bm25 is to make BM25-based full text search feel native to Postgres. pg_bm25 is built on Tantivy, a Rust-based alternative to Apache Lucene. We've integrated Tantivy into Postgres as a native index type and introduced a custom SQL operator for executing search queries. If you have any questions after trying it out, our Slack community is a great place to start https://join.slack.com/t/paradedbcommunity/shared_invite/zt-217mordsh-ielS6BiZf7VW3rqKBFgAlQ https://join.slack.com/t/paradedbcommunity/shared_invite/zt-...
- ankitml 3y agoThanks, this is interesting. Are you considering WAND support too in this? https://www.elastic.co/blog/faster-retrieval-of-top-hits-in-elasticsearch-with-block-max-wand https://www.elastic.co/blog/faster-retrieval-of-top-hits-in-...
- hellorocketman 3y agoi think this is a great idea. discovered tantivy some while ago and thought "wow, if this would be a pg extension: game changer". luckily there is a brave team who is doing this especially I like the idea that I can now calculate embeddings right away in postgres. so far I had to write custom scripts for it. wondering when I can provide my custom model. that's quite a common requirement.
- philippemnoel 3y agoYes! That will be coming very soon :)