3 ms·
CSV is fine for simple cases but has issues with versioning (adding new/optional fields) and nested data like arrays. The object stream idea is apparently supp
by ridiculous_fish 7y ago
CSV is fine for simple cases but has issues with versioning (adding new/optional fields) and nested data like arrays.
The object stream idea is apparently supported widely and seems pretty strong. Thanks for the suggestion!
- zenexer 7y agoI use JSON streams a lot with command line tools. Keep in mind that it’s limited in that each object must consume a single line. This allows you to recover from syntax errors in a single entry; each line is a fresh start. Have you considered SQLite? I know it’s not a friendly text format, but it alleviates a lot of the issues with the “append to a text file” approach, such as concurrency. It’s great for this sort of thing.