4 ms·
Do you mean directly uploading files in the UI and chatting against those files? This one will be done within the next few weeks, it's a very high value item fo
by yuhongsun 3y ago
Do you mean directly uploading files in the UI and chatting against those files? This one will be done within the next few weeks, it's a very high value item for sure.
Alternatively, if you're talking about real time indexing to make it available to everyone immediately, there's an Ingestion API, where users can send documents in the expected format directly to the system, is this what you're thinking?
The integrations are built in house, some using client libraries of the particular tool (like the Atlassian python client library for example). We considered using Airbyte, LlamaHub etc. but we found that they don't support the full flexibility that we need, including pulling incremental updates and access permissions.
- esafak 3y agoI mean streaming insertions and indexing using pub/sub or something.
- yuhongsun 3y agoGot it, we considered it but most connectors that we pull from don't support this. Might bring it back for the ones that do, thanks for the suggestion! It's actually still in the code, just none of the connectors implement it atm: https://github.com/danswer-ai/danswer/blob/main/backend/danswer/connectors/interfaces.py#L54 https://github.com/danswer-ai/danswer/blob/main/backend/dans...