3 ms·
It's a cloud offering, so the machines are located near each other. Using it with other cloud services is a fair comparison to running it in the same box on-pre
by hiddencost 5y ago
It's a cloud offering, so the machines are located near each other. Using it with other cloud services is a fair comparison to running it in the same box on-prem.
The offering is similarity search, not a search engine. They offer image to image as another comparison point.
- freediver 5y agoWith the caveat of having to use GCP to host your server too, I can agree with you (although 5ms still sounds incredibly low, how many vectors was that?). I was obviously talking about a general use case where a user considers using an API like this vs running Faiss, and their server can be anywhere (a use case that is more common to me personally).
- pierrefermat1 5y agoWe are only talking about backend performance so I don't really think it's fair to include network latency on this metric, it can also hugely varied based on your current network/location setup
- freediver 5y ago> For low-latency (up to couple of hundred milliseconds) use cases, it is highly unlikely that any cloud solution like this would be a better choice than something deployed on premise because of the *network overhead*.