4 ms·

I really don't get the supposed problem with this. Steaming XML is a mature thing, libraries in most every language for decades. Oh! you had to add a "UTF-16LE

I really don't get the supposed problem with this. Steaming XML is a mature thing, libraries in most every language for decades. Oh! you had to add a "UTF-16LE", the suffering is real... How is this hell? Did you want streaming json? it would end up being essentially the same code. YAML has to be it! (Is there a streaming parser?) This totally feels like conjured drama.

qz2 6y ago
Completely a drama. I was reading 200gb or so xml files about 15 years ago in Java using their event driven xml parser, the name of which I forget. It didn’t use a whole lot of RAM or require any thought. Basically buffer 100 rows into RAM, then process and bulk insert into our SQL box. It just took time to run and most of that was waiting for the DB. A huge chunk of businesses are based on doing exactly this and not a lot more.
- bassman9000 6y ago
  SAX