4 ms·
Makes sense. Interesting on the fact that summaries affect quality sometimes. For synthetic data scenarios are you also thinking about synthetic queries over t
by ddematheu 3y ago
Makes sense. Interesting on the fact that summaries affect quality sometimes.
For synthetic data scenarios are you also thinking about synthetic queries over the data? (Try to predict which chunks might be more used than others)
- dluc 3y agoyes, queries and also planning. For instance, given the user "ask" (which could be any generic message in a copilot), decide how to query one or multiple storages. Ultimately, companies and users have different storages, and a few can be indexed with vectors (and additional fine tuned models). But there's a lot of "legacy" structured data accessible only with SQL and similar languages, so a "planner" (in the SK sense of planners) could be useful to query vector indexes, text indexes and knowledge graphs, combining the result.