We previously have seen many possible scenarios that vineyard could be helpful in https://news.ycombinator.com/item?id=25832831 https://news.ycombinator.com/ite

We previously have seen many possible scenarios that vineyard could be helpful in https://news.ycombinator.com/item?id=25832831 https://news.ycombinator.com/item?id=25832831 After several months of development we are glad to announce our improvements that briging vineyard with the bigdata computing ecosystem, more specifically, Vineyard v0.2.7 brings many new features into experimental stage, including + Airflow Integration with Vineyard: vineyard serves as a XCom backend for airflow to support the tasks in user-defined workflow shares large volume of intermediate data using vineyard, and enables more possibilities for orchestrating bigdata analytical workloads with Airflow. To try Airflow with vineyard, please refer to https://v6d.io/notes/airflow.html https://v6d.io/notes/airflow.html + Vineyard brings dask integration in this release, data in vineyard can be consumed and produced by dask procedures, and can be further shared by other compute engines that works on Vineyard. For a end-to-end demo, please refer to https://v6d.io/notes/dask.html https://v6d.io/notes/dask.html + Vineyard now can serve as the data source for ML frameworks, e.g., tensorflow, pytorch and xgboost. (thanks @chaitravi-ce ) + Vineyard Go SDK (thanks @linlih) and Java SDK (thanks @zhanglei1949) comes into a very preliminary stage. Vineyard v0.2.7 will the last release of v0.2.x series and v0.3.0 will come next week!