3 ms·
Hey, yes, this gets more complicated as datasets get larger. Our early customers have simple datasets (using spreadsheets, csvs, and relatively small postgres
by zahmed1 3y ago
Hey, yes, this gets more complicated as datasets get larger.
Our early customers have simple datasets (using spreadsheets, csvs, and relatively small postgres or mysql dbs), so it works very well for them.
As we continue to move to larger customers, data warehouses, and more complex use cases, we'll build semantic layers (aka. provide a lot of context on the db, tables, business metrics, sample queries, and more), use RAG alongside our SQL agent, introduce more robust auditing / RLHF, etc. All solvable as our customer needs require it.
Also, context window limits continue to increase, and since we're plugging into the best models to solve customer problems (not building our own), tbd on how much of what I've listed above (e.g. RAG) we'll need to do when the time comes.