3 ms·
My team has worked on a library for a similar purpose: https://github.com/capitalone/DataProfiler https://github.com/capitalone/DataProfiler Load any document
by lettergram 5y ago
My team has worked on a library for a similar purpose:
https://github.com/capitalone/DataProfiler https://github.com/capitalone/DataProfiler
Load any document, profile and monitor the profiles for changes that would impact downstream applications.
Very common problem, you all are in a great space! Very interested and will check out!
- kzh_ 5y agoNice work! Love the support for merging profiles together and also profiling unstructured data. I could’ve used this all of the time back in research days, instead of having to do the profiling by hand and from scratch every time. We definitely want to explore suggesting data tests based on profiling. Don’t be surprised if you see a fork!
- big_big_data 5y agothis is cool !! have you experimented with getting this to run on large datasets ? IE: running this with Spark or on your datawarehouse ?