Nice, I needed to do this task recently for large CSVs (15gb) and didn’t come across this tool. Under the hood it manipulates the CSV using pandas data frames,

Nice, I needed to do this task recently for large CSVs (15gb) and didn’t come across this tool. Under the hood it manipulates the CSV using pandas data frames, then finally dumps the data frame into sqlite using `dataframe.to_sql(sqlite_conn)`. I wonder how fast this is, if it has to take each row from the data frame through Python it can’t be that quick but maybe there’s something smart happening under the hood that can punch a native-to-native pathway through the Python abstractions. I ended up writing my own in Golang since the ones I found in C and other languages didn’t use threads or did too much memory copying.