3 ms·
TLDR API: VADD key [VALUES <float float ...> | FP32 <binary blob>] element VSIM key [VALUES ... | FP32 ... | ELE ...] [COUNT <count>] [EPSION <max distance>]
by antirez 2y ago
TLDR API:
VADD key [VALUES <float float ...> | FP32 <binary blob>] element
VSIM key [VALUES ... | FP32 ... | ELE ...] [COUNT <count>] [EPSION <max distance>]
VCARD key (number of elements)
VDIM key (dimension of the vectors)
VDEL key <ele>
And so forth. However there are nice things you can enable, if you want. For instance VADD has the [REDUCE] option that implements random projection in order to reduce the dimensionality of your embeddings. Less memory, and it is faster. And so forth.
Will work on it during xmas, it's quite fun.
It implements on-insertion normalization and int8 quantization. The algorithm to insert nodes inside the HNSW attempts to never leave isolated nodes and to get good quality links and so forth. More hacking needed.
- le-mark 2y agoHuh Charles actually can code? We’ll then.
- isoprophlex 2y agoyes loving this! please PLEASE be the hero we need in unfucking the unholy mess of misdirection and useless abstraction that is storing some vectors somewhere for similarity search right now
- revskill 2y agoU mean there are too much leaky abstractions in the field now ?