4 ms·
Unveiling Ragna: An Open Source RAG-Based AI Orchestration Framework
- nkaretnikov 3y agoMy colleagues at Quansight released Ragna. It's pretty cool! In the blogpost, there's a demo: you upload a pdf, ask ML model a question, it answers and shows which pages it looked at in the document. If you don't trust the output, you can double-check the doc since you have the page numbers. Ragna currently ships with pre-built extensions for OpenAI, MosaicML, Anthropic, and local LLMs as well as the Chroma and LanceDB vector databases. And it's open source, too!
- abss 3y agoHow it works?
- nkaretnikov 3y agoAre you asking about the query/tokenization or the overall architecture? I assume it's the former. It's explained in the post after the diagram, see "The diagram illustrates a series of steps [...]". We get a user query. Based on that query, we pull relevant parts from the doc. Then, we submit both the query and the doc parts to an LLM. This limits the amount of data we need to send and allows the user to know which parts of the doc are relevant.
- nkaretnikov 3y agoThere'll be a talk at PyData NYC 2023 on Ragna as well: https://nyc2023.pydata.org/cfp/talk/7DPRGM/ https://nyc2023.pydata.org/cfp/talk/7DPRGM/
- esafak 3y agohttps://ragna.chat/ https://ragna.chat/ https://github.com/Quansight/ragna https://github.com/Quansight/ragna
- yding 3y agoCongrats on the launch!
- jeffchuber 3y agocool :) (jeff from chroma)
- raylad 3y agoWhat are Ragna's competitors? Or just other options for something similar.
- Dnguyen 3y agoI'm trying out the demo and it's taking forever for just one small file. What do you recommend for a minimum system to try this out?
- nkaretnikov 3y agoCould you start a new discussion here? https://github.com/Quansight/ragna/discussions https://github.com/Quansight/ragna/discussions
- moltar 3y agoCould you please compare it to Zep?
- qscftyhm 3y agohow should we start the chart and i was getting no open_api_key and there is no code to enter the key. can i get any tutorial to open the ragna chat?