5 ms·

This sounds like a good task for ragel http://www.colm.net/open-source/ragel/ http://www.colm.net/open-source/ragel/

• jacobush 6y ago
  Why?
  • Cloudef 6y ago
    Ragel (or more like finite state machines) excel at parsing streams with all sorts of nuances while still being rigid and bailing on invalid input. Considering the ken_all.csv isn't really standard csv anymore, it's better to write tailored parser for it, than to approach it as a typical csv file.
    • jacobush 6y ago
      I thought you meant using Ragel would be better than https://github.com/polm/posuto https://github.com/polm/posuto what Posuto is currently doing.
      • Cloudef 6y ago
        Nah, didn't imply that. Just that ragel would be suitable to generate the parser for this kind of data.