3 ms·
I've used the Sentence Transformers Python library successfully for this: https://www.sbert.net/ https://www.sbert.net/ My own LLM CLI tool and Python library
by simonw 2y ago
I've used the Sentence Transformers Python library successfully for this: https://www.sbert.net/ https://www.sbert.net/
My own LLM CLI tool and Python library includes plugin-based support for embeddings (or you can use API-based embeddings like those from Jina or OpenAI) - here's my list of plugins that enable new embeddings models: https://llm.datasette.io/en/stable/plugins/directory.html#embedding-models https://llm.datasette.io/en/stable/plugins/directory.html#em...
More about that in my embeddings talk from last year: https://simonwillison.net/2023/Oct/23/embeddings/ https://simonwillison.net/2023/Oct/23/embeddings/