8 ms·
Could you clarify what "keep track of state of assets" means?
by sethjr5rtfgh 4y ago
Could you clarify what "keep track of state of assets" means?
- glogla 4y agohttps://www.dagster.io/blog/software-defined-assets https://www.dagster.io/blog/software-defined-assets Of course, nothing stops Airflow or other tools fron thinking this way as well.
- geoffjentry 4y agoIt's a mindset shift to a more declarative model. The idea has also popped up in other niche orchestrators. This is an oversimplification but IMO the easiest way of picturing it is instead thinking of defining your graph as a forward moving thing w/ the orchestrator telling things they can be run you shift to defining your graph nodes to know their dependencies and they let the orchestrator know when they're runnable.