3 ms·
Out of curiosity why is jsonl so popular in the ML space?
by Tokumei-no-hito 3y ago
Out of curiosity why is jsonl so popular in the ML space?
- fbdab103 3y agoNot speaking for ML, but I love jsonl as a distribution format. Lots of storage overhead vs a more appropriate bulk container, but it makes it trivial to stream, sample, concatenate, etc. Anything else (eg csv or parquet) is going to require better tooling and/or just a little shell magic to handle headers.