Data engineer, here. Or at least, that has been my title a couple of times. Some data is inherently trash but a huge part of the data quality problem is source

Data engineer, here. Or at least, that has been my title a couple of times. Some data is inherently trash but a huge part of the data quality problem is sources who are allowed to produce trash that everyone else has to clean up, when it would be way more efficient for them to quit producing trash. Not to pick on any one institution, but SOAP seems to be a read flag that the service will also deliver some screwy data.