4 ms·
This may be a stupid question, but how would one generate the vectors that this uses? (I assume you can't just feed it images or 3d models?)
by RobotToaster 4y ago
This may be a stupid question, but how would one generate the vectors that this uses? (I assume you can't just feed it images or 3d models?)
- fzliu 4y agoThis is typically done by taking the activations from a neural network. Activations from layer depths are generally preferred since they are more representative.
- yeldarb 4y agoGood timing -- we actually just published a tutorial showing how to build semantic image search (including generating vectors with CLIP) with faiss this morning: https://blog.roboflow.com/clip-semantic-search/ https://blog.roboflow.com/clip-semantic-search/
- jeadie 4y agoIt will depend on the type of data you are using, and then what you are planning on doing with it. Various open source models will take various modalities (e.g. images of models), and will create an embedding/vector for them (even if just as an internal representation). You can take these, and store them in a vector DB. This may help https://www.marqo.ai/blog/how-to-implement-text-to-image-search-on-marqo-in-5-lines-of-code https://www.marqo.ai/blog/how-to-implement-text-to-image-sea...
- deleted 4y ago[deleted]