3 ms·

I maintain a similar project, load any CSV, manipulate and get stats, detect sensitive data, etc https://github.com/capitalone/DataProfiler https://github.com/

I maintain a similar project, load any CSV, manipulate and get stats, detect sensitive data, etc https://github.com/capitalone/DataProfiler https://github.com/capitalone/DataProfiler My question, how do you do header detection? That's a _very_ difficult problem.

nojito 6y ago
You could emulate what data.table does and allow a search string variable to identify the header row. https://github.com/h2oai/datatable/blob/385a9b370db32de90135153cb67c8f26032ad937/src/core/read/py_fread.cc#L136 https://github.com/h2oai/datatable/blob/385a9b370db32de90135...