4 ms·
Is there something like oobabooga to easily run this in a click-and-run way? Where I can load up a model, a text, and ask it questions?
by Nitrolo 3y ago
Is there something like oobabooga to easily run this in a click-and-run way? Where I can load up a model, a text, and ask it questions?
- brucethemoose2 3y agoiirc ooba has its own integrated vectordb called superbooga. I bet you could hack this in.
- simonw 3y agoSee my comment here: https://news.ycombinator.com/item?id=38020655 https://news.ycombinator.com/item?id=38020655 for a CLI tool that lets you do this. Note that embedding models are a different kind of thing from a Large Language Model, so it's not the kind of model you can ask questions. It's a model which can take text and turn it into an array of floating point numbers, which you can then use to implement things like semantic search and related documents. More on that here: https://simonwillison.net/2023/Oct/23/embeddings/ https://simonwillison.net/2023/Oct/23/embeddings/
- minimaxir 3y agoThe Hugging Face page for the model has a two line load-and-encode Python code demo: https://huggingface.co/jinaai/jina-embeddings-v2-base-en https://huggingface.co/jinaai/jina-embeddings-v2-base-en