3 ms·
Until recently we used them at Snowplow for orchestrating data processing pipelines, per this blog post: https://snowplowanalytics.com/blog/2015/10/13/orchestr
by alexatkeplar 9y ago
Until recently we used them at Snowplow for orchestrating data processing pipelines, per this blog post:
https://snowplowanalytics.com/blog/2015/10/13/orchestrating-batch-processing-pipelines-with-cron-and-make/ https://snowplowanalytics.com/blog/2015/10/13/orchestrating-...
We gradually swapped them out in favour of our own DAG-runner written in Rust, called Factotum:
https://github.com/snowplow/factotum https://github.com/snowplow/factotum