3 ms·
What is powering the vectorized query execution? Are you embedding something like DataFusion or is it entirely custom? (Also will any of this be open sourced?)
by chatmasta 3y ago
What is powering the vectorized query execution? Are you embedding something like DataFusion or is it entirely custom? (Also will any of this be open sourced?)
- mritchie712 3y agonot sure what's powering crunchy, but you might be interested in Parade: https://blog.paradedb.com/pages/introducing_analytics https://blog.paradedb.com/pages/introducing_analytics
- craigkerstiens 3y agoIt's not datafusion, much more custom with a number of extensions that underly pieces. And we've got a number of other extensions that will be in the works, to the user it's still a seamless experience but we've seen that smaller extensions that know how to work together are easier to maintain. For example we're working on a map type one that knows how to understand the map types within Parquet files within Postgres. In time we may open source some of these pieces, but we don't have a time frame for that and it's a case by case on each of the extensions.