5 ms·
I work on the team that built this and many of our other ranking tech. I can answer any questions people have. Also shameless plug: using this tech we released
by danielcampos93 7y ago
I work on the team that built this and many of our other ranking tech. I can answer any questions people have.
Also shameless plug: using this tech we released some artificial search sessions as an exploratory dataset. https://github.com/dfcf93/MSMARCO/tree/master/ConversationlSearch https://github.com/dfcf93/MSMARCO/tree/master/ConversationlS...
- mv4 7y agothe Github link gave me a 404 update: you made a typo, should be https://github.com/dfcf93/MSMARCO/tree/master/ConversationalSearch https://github.com/dfcf93/MSMARCO/tree/master/Conversational...
- mv4 7y agoCool project! One of the challenging use cases mentioned in the description is people taking a picture and asking the search engine, 'What is this?'. Has this been solved? (it is a very hard problem if taken beyond simple object classification)
- danielcampos93 7y agoIn many ways yes. For images Instead of using some NLP parser and vectorization technique you vectorize the image and then do a similar lookup
- danielcampos93 7y agoIf you want to play with the tech there is a developer kit. https://www.bingvisualsearch.com/develop https://www.bingvisualsearch.com/develop
- mv4 7y agohow effective is it at identifying mysterious objects, the way it's crowdsourced on Reddit's "/Whatisthis"? (meaning, how big is the index?)
- 13of40 7y agoLOL - that's exactly the use case I was thinking of. But wouldn't an AI have to be trained with lots of examples of the item in question to get a high quality detection? If so, it might not be able to find that one image that antique shop in Whereverston has on their web site.
- danielcampos93 7y agoI don't work on the image side but from what I understand the entire index is vectorized so its not categorizing them like a imagenet system would as much as finding a nearest neighbor that can be categorized.
- sinkpoint 7y agoGreat work! How does this compare to hierarchical navigable small world graph, like nmslib?
- danielcampos93 7y agoI wasnt really familiar with nmslib but I guess I think its a little bit faster and scales to billions of items.
- bobosha 7y ago1. how's this different from pysparnn or faiss? 2. does this support both sparse and dense vectors ann?