4 ms·
I once created a simple script in NodeJS to merge two or more CSV files and remove duplicates. You might find it useful. https://www.npmjs.com/package/merge-cs
by modinfo 5y ago
I once created a simple script in NodeJS to merge two or more CSV files and remove duplicates. You might find it useful.
https://www.npmjs.com/package/merge-csv-keepass https://www.npmjs.com/package/merge-csv-keepass
- nullbytesmatter 5y agoYour script parses the entire CSV and then dedupes in memory. This would require ~3TB+ RAM.