4 ms·
Is anybody out there doing anything interesting with Airflow monitoring? At my startup Cronitor we have an Airflow sdk[0] that makes it pretty easy to provisio
by encoderer 4y ago
Is anybody out there doing anything interesting with Airflow monitoring?
At my startup Cronitor we have an Airflow sdk[0] that makes it pretty easy to provision monitoring for each DAG, but essentially we are only monitoring that a DAG started on time and the total time taken. I keep thinking about how we could improve this and it would be great to hear about what’s working well today for monitoring.
[0] https://github.com/cronitorio/cronitor-airflow https://github.com/cronitorio/cronitor-airflow
- rozhok 4y agoI'm working at https://databand.ai https://databand.ai — a full-fledged solution for Apache Ariflow monitoring, data observability and lineage. We have airflow sync, integrations with Spark/Databricks/EMR/Dataproc/Snowlake, configurable alerts, dashboards, and a much more. Check it out.