3 ms·

How does this compare to Pandas?

• MapleWalnut 7y ago
  This project appears to have a dependency on pandas. https://github.com/alan-turing-institute/CleverCSV/blob/master/setup.py https://github.com/alan-turing-institute/CleverCSV/blob/mast...
  • donarb 7y ago
    That dependency is merely a wrapper to allow CleverCSV to load data directly into a Pandas data frame. It doesn't require pandas just for loading csv data.
• donarb 7y ago
  Pandas uses the Python csv module under the hood. Most of the code in the read_csv method is used to get the data from the csv file and load it into data frames.
  • urschrei 7y ago
    Are you sure? Wes McKinney rewrote the Pandas CSV parser way back in late 2012 because the batteries-included version was slow and memory-hungry. Did Python upstream his version later on, or replace it with something faster (I'd be surprised if they did either, but I'd be curious to know)
    • evanpw 7y ago
      It's configurable. The default parser is written in C, but it's possible to use a parser based on the csv module if you needs things like separators specified by a regex.