Cleaning data is usually very low on the totem pole of priorities for many companies. It is often a very manual and time consuming process. Support from managem

Cleaning data is usually very low on the totem pole of priorities for many companies. It is often a very manual and time consuming process. Support from management to fix it can be very poor. Relational tables with millions or billions of rows can contain many different kinds of errors. Finding and fixing them can be like finding a few dozen needles in a field of haystacks. I was working on a tool to make it much easier to find and fix anomalies. I used the Chicago crime data (available for free download on the city's open data portal) to show how easy it was to find and fix problems. Here is a short video of some of the things it found: https://www.youtube.com/watch?v=kqkNeU1LYEQ https://www.youtube.com/watch?v=kqkNeU1LYEQ I contacted the people responsible for managing the data to show them some of the problems and how to fix them. They seemed like they could not be any less interested.