6 ms·
RAG cli from llamaindex, allow you to do it 100% locally when used with ollama or llamacpp instead of OpenAI. https://docs.llamaindex.ai/en/stable/getting_star
by pierre 2y ago
RAG cli from llamaindex, allow you to do it 100% locally when used with ollama or llamacpp instead of OpenAI.
https://docs.llamaindex.ai/en/stable/getting_started/starter_tools/rag_cli/ https://docs.llamaindex.ai/en/stable/getting_started/starter...
- homarp 2y agoand at some point (https://github.com/ggerganov/llama.cpp/issues/7444 https://github.com/ggerganov/llama.cpp/issues/7444) you will be able to use Phi-3-vision https://huggingface.co/microsoft/Phi-3-vision-128k-instruct https://huggingface.co/microsoft/Phi-3-vision-128k-instruct but for now you will have to use python. You can try it here https://ai.azure.com/explore/models/Phi-3-vision-128k-instruct/version/1/registry/azureml https://ai.azure.com/explore/models/Phi-3-vision-128k-instru... to get an idea of its OCR + QA abilities
- ekianjo 2y agollamaindex has an horrible API, very poor docs and is constantly changing. I do not recommend it.
- papichulo2023 2y agoAny alternative?
- vladsanchez 2y agoLOL `papichulo`? Que tigre!?
- papichulo2023 2y agoJaja la primera palabra que se me vino a la cabeza
- hm-nah 2y agoVanilla python
- dmd 2y agoSo your solution to “I don’t like flying [specific airline]” would be “how about a big pile of aluminum and some jet fuel”?
- jd3 2y agobasically, still the same answer(s) from https://news.ycombinator.com/item?id=38759877 https://news.ycombinator.com/item?id=38759877 https://news.ycombinator.com/item?id=36832572 https://news.ycombinator.com/item?id=36832572
- nl 2y agoDoes the llamaindex PDF indexer correctly deal with multi-column PDFs? Most I've seen don't, and you get very odd results because of this.
- pierre 2y agoLocally you can choose pypdf or mupdf wich are good but not perfect. If you can send your data online llamaparse is quite good.
- j45 2y agoPulling the text out of the PDFs correctly and independently is correct.
- rspoerri 2y agoi've made quite good conversions from pdf to markdown with https://github.com/VikParuchuri/marker https://github.com/VikParuchuri/marker . it's slow but worth a shot. Markdown should be easily parseable by a rag. i'm trying to get a similar system setup on my computer.
- nl 2y agoThis looks worth exploring, so thanks. The author has done a bunch of work beyond what PyMuPDF does on multicolumn layouts.
- tspann 2y agohttps://milvus.io/docs/integrate_with_llamaindex.md https://milvus.io/docs/integrate_with_llamaindex.md Pretty easy to run local and lightweight with Milvus Lite with LlamaIndex