4 ms·
Curious, what type of database are you using for storing the language AI features? I would guess SQL as it's structured but could be wrong. Are you planning to
by doozko 4y ago
Curious, what type of database are you using for storing the language AI features? I would guess SQL as it's structured but could be wrong. Are you planning to support embeddings too, that will probably help to make the search semantic instead of keyword based.
- EniasCailliau 4y agoWe have a database engine layer that can wrap around multiple databases. Today though we're mainly using SQL since it's so fast with the right indexing. Soon though we're planning to support search using embeddings too. We'll probably use an optimised db for that like faiss or ngt.
- eob 4y agoWe've built a hybrid database that federates workloads & queries atop both a relational & vector component. Right now we've got fairly limited interaction between those two halves of the brain, but it's one of the things that gets me most excited when thinking about potential. There's a lot of great work going on in this space too, by the way -- everything from PostGres plugins for vectors to vector databases adding relations to things in between. It's going to be awesome few years to watch. There's a real pull toward finding a way to comfortably merge the two: it enables some pretty incredible queries.