It's not clear what you're doing with your data, but sqlite may be a viable option as well. Using a million row sample from here: https://blog.majestic.com/de

It's not clear what you're doing with your data, but sqlite may be a viable option as well. Using a million row sample from here: https://blog.majestic.com/development/majestic-million-csv-daily/ https://blog.majestic.com/development/majestic-million-csv-d... Taking a summary of the data: > cat csvtest.sql .mode csv .import majestic_million.csv rankings select TLD,count(TLD) as cnt from rankings group by TLD order by cnt desc limit 10; > time sqlite3 < csvtest.sql com,402802 top,96734 cn,72029 net,55131 org,45948 gdn,40246 ru,29746 cc,27117 de,19291 uk,14971 real 0m6.295s user 0m6.089s sys 0m0.156s