3 ms·
Can you use https://github.com/abetlen/llama-cpp-python https://github.com/abetlen/llama-cpp-python or you need something ollama provide ? speaking of embeddin
by homarp 2y ago
Can you use https://github.com/abetlen/llama-cpp-python https://github.com/abetlen/llama-cpp-python or you need something ollama provide ?
speaking of embeddings, you saw https://jina.ai/news/jina-embeddings-v3-a-frontier-multilingual-embedding-model https://jina.ai/news/jina-embeddings-v3-a-frontier-multiling... ?
- punnerud 2y agoSwitching to a low level integration will probably not improve the speed, the waiting is primarily on the llama generation of text. Should be easy to switch embeddings. Already playing with adding different tags to previous answers using embeddings, then using that to improve the reasoning.