3 ms·

ElasticSearch has "dense_vector" datatype and vector-specific functions. https://www.elastic.co/guide/en/elasticsearch/reference/current/dense-vector.html

ElasticSearch has "dense_vector" datatype and vector-specific functions. https://www.elastic.co/guide/en/elasticsearch/reference/current/dense-vector.html https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-script-score-query.html#vector-functions ZomboDB integrates ElasticSearch as a PG extension, written in Rust: https://github.com/zombodb/zombodb I dunno what exactly a "dense_vector" is, but if you can't use the native "tsvector" maybe you could use this?

anentropic 5y ago
I think a dense vector is the opposite of a sparse vector i.e. in a dense vector every value in the vector is stored whereas sparse vectors exist to save space when you have large vectors where most of the values are usually zero - they reconstruct the full vector by storing only the non-zero values, plus their indices
- gavinray 5y ago
  "a dense vector is the opposite of a sparse vector" I think there's another thing besides vectors that are a bit dense in the room here, eh? Yeah that makes sense hahaha -- thank you.
TOMDM 5y ago
ZomboDB has always seemed really interesting to me. Elastics search, with PostgreSQL's everything else sounds like a perfect match, but I've never seen it used anywhere which is kind of spooky to me. Do you know of any non-toy use cases I can look at?
- gavinray 5y ago
  You can ask Eric Ridge on the ZomboDB Discord, he's really nice: https://discord.gg/hPb93Y9 https://discord.gg/hPb93Y9 Also probably one of the most knowledgeable people about both Postgres and Rust I've ever met. He makes his living primarily from supporting enterprises using ZomboDB (I think), not sure how much he can say, but it's worth asking.
  - TOMDM 5y ago
    You're not kidding, they were incredibly friendly and helpful. Makes me wish I had a big deployment so I could justify sponsoring them. I paid in cat pictures for now.

anentropic 5y ago

I think a dense vector is the opposite of a sparse vector i.e. in a dense vector every value in the vector is stored whereas sparse vectors exist to save space when you have large vectors where most of the values are usually zero - they reconstruct the full vector by storing only the non-zero values, plus their indices

gavinray 5y ago
"a dense vector is the opposite of a sparse vector" I think there's another thing besides vectors that are a bit dense in the room here, eh? Yeah that makes sense hahaha -- thank you.

TOMDM 5y ago

ZomboDB has always seemed really interesting to me. Elastics search, with PostgreSQL's everything else sounds like a perfect match, but I've never seen it used anywhere which is kind of spooky to me. Do you know of any non-toy use cases I can look at?

gavinray 5y ago
You can ask Eric Ridge on the ZomboDB Discord, he's really nice: https://discord.gg/hPb93Y9 https://discord.gg/hPb93Y9 Also probably one of the most knowledgeable people about both Postgres and Rust I've ever met. He makes his living primarily from supporting enterprises using ZomboDB (I think), not sure how much he can say, but it's worth asking.
- TOMDM 5y ago
  You're not kidding, they were incredibly friendly and helpful. Makes me wish I had a big deployment so I could justify sponsoring them. I paid in cat pictures for now.