sryza

5 ms·

1. 1.▲
   by sryza 3y ago

   Intro text: In the life of a data engineer, perhaps nothing inspires more difficulty or awe than the backfill. Flub a backfill, and you'll have bad data, angry stakeholders, and a fat cloud bill. Nail a backfill, and you're reward
2. 2.▲
   Backfills in Data and Machine Learning: A Primer(dagster.io)

   2 points by sryza 3y ago|1 comments
3. 3.▲
   by sryza 4y ago

   Yeah, I don't mean to knock large Apache projects in general - they can be great software. My point is that it's hard for them to change / successfully copy their competitors. Much of what makes Spark successful was there at
4. 4.▲
   by sryza 4y ago

   Dagster contributor here responding to Astronomer employee ^^. A "quickly-implemented" feature != parity in utility. E.g. Airflow's TaskFlow superficially looks like some of Dagster's APIs, but the experience of using th
5. 5.▲
   Dagster Software-Defined Assets, Declarative Data Management in Python(dagster.io)

   3 points by sryza 5y ago|0 comments
6. 6.▲
   Solving NP-Hard Problems the Easy Way(blog.remix.com)

   2 points by sryza 9y ago|0 comments