It's been my go-to tool for almost a decade for figuring out what's in strange files, and working out how to ingest them. I learned about it from ProPublica.co

It's been my go-to tool for almost a decade for figuring out what's in strange files, and working out how to ingest them. I learned about it from ProPublica.com; they used it in their series about payola to doctors from big pharma. https://www.propublica.org/nerds/using-google-refine-for-data-cleaning https://www.propublica.org/nerds/using-google-refine-for-dat... It's Java. You can mess with the virtual-memory jvm parameters to make it handle more data. It has a disadvantage in the workplace: it's hard for some managers to believe it's local only. The name Google on it means, to them, that it must upload data to cloud servers owned by Google. Maybe the rebranding has reduced that hurdle.