3 ms·
Ask HN: Can anyone recommend a data quality solution?
We're looking for an inexpensive data quality solution (app/framework) to assist us with the identification of gaps in time-series data as well as the identification of potentially problematic data points using some basic statistics.
Ideally, I'd want to be able to host the solution and automate it to run daily and spit out a report outlining potential issues. The data is all normalized and housed in a single SQL DB. We've written our own bespoke framework for this, but our team is too small to realistically maintain it.
Any suggestions?
- jstx1 4y agoI would go in-house on this one, I can't see the value of configuring someone else's solution over writing a few lines of Python to run the checks that you need. And you've already built that too - why do you think it would be difficult to maintain?
- demiusza 4y agoWell, ultimately I'd like our data custodians to be able to manage the solution themselves. Our dev contingent is tiny, so in a perfect world, I'd love for the analysts to own the solution.
- streetcat1 4y agoWhat is inexpensive?
- altdataseller 4y agoMonte Carlo might be something to look into.