4 ms·

This is a great writeup, and awesome to see vector databases come up more and more often. For anyone interested in going down this rabbit hole, we have an enti

by gk1 5y ago

This is a great writeup, and awesome to see vector databases come up more and more often. For anyone interested in going down this rabbit hole, we have an entire learning center about vector databases and vector search (https://www.pinecone.io/learn/ https://www.pinecone.io/learn/) including the obligatory "What is a Vector Database" intro with example notebooks: https://www.pinecone.io/learn/vector-database/ https://www.pinecone.io/learn/vector-database/

starkd 5y ago
Thank you for this. One approach I find missing in your blog is that of distance-based indexing. It's an approach that indexes vectors according to distances from chosen vantage points from within the data set. I've done some preliminary work on creating a system for images: phash.dev
liminal 5y ago
Pinecone looks great. Any plans to have a non-hosted option?
dang 5y ago
You've posted several comments in this thread alone linking to your product, and it seems that the majority of your posts have been doing this for quite a while now. I'm sure it's excellent work, but can you please stop doing this? It's fine to link to your own work occasionally, when it's particularly relevant, as part of a diverse mix of posts on unrelated things*. It's not ok to use HN primarily for promotion. See https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html: "Please don't use HN primarily for promotion. It's ok to post your own stuff occasionally, but the primary use of the site should be for curiosity." When people do that we eventually start penalizing their accounts and sites, or in egregious cases, banning them. You're a good HN user, but this is still excessive. You're crossing the line at which the community starts to think of the word 'spam', and we inevitably start getting emails about it. * I do get that your work is particularly relevant in a thread like this. What's missing is the 'diverse mix of posts on unrelated things'. In such a context, posting repeatedly about your own stuff starts to come across the wrong way.
- pathsjs 5y ago
  For what is worth, I do appreciate their links, and their resources are pretty informative (I am not by any means affiliated with Pinecone)
- gk1 5y ago
  Dully noted! In part it's a reflection of what I think about -- which these days is mainly what I work on. Totally get what you're saying though, and how it might look from the outside.

by gk1 5y ago

starkd 5y ago

Thank you for this. One approach I find missing in your blog is that of distance-based indexing. It's an approach that indexes vectors according to distances from chosen vantage points from within the data set. I've done some preliminary work on creating a system for images: phash.dev

liminal 5y ago

Pinecone looks great. Any plans to have a non-hosted option?

dang 5y ago

You've posted several comments in this thread alone linking to your product, and it seems that the majority of your posts have been doing this for quite a while now. I'm sure it's excellent work, but can you please stop doing this? It's fine to link to your own work occasionally, when it's particularly relevant, as part of a diverse mix of posts on unrelated things*. It's not ok to use HN primarily for promotion. See https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html: "Please don't use HN primarily for promotion. It's ok to post your own stuff occasionally, but the primary use of the site should be for curiosity." When people do that we eventually start penalizing their accounts and sites, or in egregious cases, banning them. You're a good HN user, but this is still excessive. You're crossing the line at which the community starts to think of the word 'spam', and we inevitably start getting emails about it. * I do get that your work is particularly relevant in a thread like this. What's missing is the 'diverse mix of posts on unrelated things'. In such a context, posting repeatedly about your own stuff starts to come across the wrong way.

pathsjs 5y ago
For what is worth, I do appreciate their links, and their resources are pretty informative (I am not by any means affiliated with Pinecone)
gk1 5y ago
Dully noted! In part it's a reflection of what I think about -- which these days is mainly what I work on. Totally get what you're saying though, and how it might look from the outside.