4 ms·
Velox could be competitor of datafusion. It is more focus on execution engine and could be great to integrate to other high performance databases. Database wil
by redskyluan 3y ago
Velox could be competitor of datafusion. It is more focus on execution engine and could be great to integrate to other high performance databases.
Database will be split into pieces and rebuild!
- sakras 3y agoYes this has been an up-and-coming theme in the data science world. Arrow for the data format, Ibis for the API, Acero/Velox/DataFusion/DuckDB/Polars for execution, Substrait for the query plan representation, etc.
- soulbadguy 3y agoIsn't spark already providing a bundled and somewhat functional version of all of this ?
- sakras 3y agoRight, so I think the idea is to "unbundle" this so that you can compose your own data analytics engine.
- redskyluan 3y agoBy the way, we are looking for talents of velox, data fusion, ducdb, clickhouse to build the world's fastest vector db milvus(mainly on search side). Contact me if you have this background!