3 ms·
This article seems written by someone who never had to work with diverse data pipelines I think that's a little unfair, it sounds like the author does have a d
by iainmerrick 3y ago
This article seems written by someone who never had to work with diverse data pipelines
I think that's a little unfair, it sounds like the author does have a decent amount of experience working with real-world CSV files:
I remember spending hours trying to identify an issue that caused columns to "shift" around 80% into a 40GB CSV file, and let me tell you, that just isn't fun.