4 ms·

Do any of y'all have an opinion on which of the tools mentioned here is the most robust to junky input?

• alaithea 12y ago
  That depends on what you want to do with your junky input. And if it's junky enough, no tool is going to be able to divine what you want to do with the data until you do some manual cleanup. However, just to put it out there, csvkit has a utility, csvclean, that will split a file based on which lines are valid csv and which are not, allowing you to more quickly dive into what's wrong with the bad lines.
  • joncooper 12y ago
    That alone would be helpful. Thanks!