3 ms·
Some snippets: > Leverages concentration of measure phenomena > Uses anisotropic vector quantization to optimize inner product accuracy by penalizing errors i
by DoctorOetker 2y ago
Some snippets:
> Leverages concentration of measure phenomena
> Uses anisotropic vector quantization to optimize inner product accuracy by penalizing errors in directions that impact high inner products, achieving superior recall and speed.
I only skimmed the article, but the 2 words I emphasized seems to imply they apply a quadratic metric for distance, i.e. they assume the data coordinates are with respect to non-orthogonal basis vectors, resulting in off-diagonal distance metric terms.
- VoVAllen 2y agoHi, I'm the author of the article. We actually rely on a new quantization method called RaBitQ instead of ScaNN. You can read more about it at https://dev.to/gaoj0017/quantization-in-the-counterintuitive-high-dimensional-space-4feg https://dev.to/gaoj0017/quantization-in-the-counterintuitive....