swordsmith8

6 ms·

1.
by swordsmith8 3y ago
Thanks for sharing! Seems like this is a dbt-centric lineage tool that surfaces failed tests in the lineage itself? Unlike a data observability platform like Monte Carlo which proactively monitors data, am I correct in assuming that your so
2.
Data Reliability vs. Data Quality(softwareengineeringdaily.com)
2 points by swordsmith8 3y ago|0 comments
3.
The Chaos Data Engineering Manifesto: Spare the Rod, Spoil Prod(montecarlodata.com)
2 points by swordsmith8 4y ago|0 comments
4.
ELT Schedules Can Improve Root Cause Analysis for Data Engineers(montecarlodata.com)
7 points by swordsmith8 4y ago|1 comments
5.
by swordsmith8 4y ago
At Monte Carlo, we did some work on root cause analysis for data failures, like ETL job failures, timeouts, data delays, etc. I think there's a lot that can be done from a data science perspective to automate RCA, or provide better ins
6.
Data Engineers Spend 2 Days per Week Firefighting Bad Data(montecarlodata.com)
16 points by swordsmith8 4y ago|4 comments
7.
by swordsmith8 4y ago
Seems like the the key pillars are: freshness, volume, schema, distribution, and lineage. Makes more sense this way, I think... If you think about metrics, traces, and logs (software observability pillars) as three distinct things, it'
8.
Data Engineer's Spotify Playlist(open.spotify.com)
2 points by swordsmith8 4y ago|0 comments
9.
First small batch data observability platform(montecarlodata.com)
1 points by swordsmith8 5y ago|0 comments
10.
Building field-level lineage for modern data systems(infoq.com)
11 points by swordsmith8 5y ago|0 comments
11.
The Data Mash (Monster Mash Parody)(youtube.com)
7 points by swordsmith8 5y ago|0 comments
12.
Anomaly Detection: Why Your Data Team Is Just Not That into It(montecarlodata.com)
2 points by swordsmith8 5y ago|0 comments
13.
Decoding the Data Mesh(montecarlodata.com)
2 points by swordsmith8 5y ago|0 comments
14.
by swordsmith8 5y ago
https://towardsdatascience.com/what-is-a-data-mesh-and-how-n...
15.
by swordsmith8 5y ago
Data mesh case studies: https://medium.com/intuit-engineering/intuits-data-mesh-stra... & https://towardsdatascience.com/from-0-to-data-mesh-kolibri-g...
16.
How to extract data observability metrics from Snowflake(montecarlodata.com)
5 points by swordsmith8 5y ago|0 comments
17.
What Is Data Observability and Why Does It Matter?(thenewstack.io)
1 points by swordsmith8 5y ago|0 comments
18.
by swordsmith8 6y ago
Agreed, like the dual language support! So useful given the rise of "analytics engineers" and other data org multi-tool workers.
19.
Data Software-as-a-Service: The Case for a Hybrid Deployment Architecture(montecarlodata.com)
1 points by swordsmith8 6y ago|0 comments