3 ms·
The flexibility of JSON is a downside when you just want to stream large volumes of row-oriented tabular data
by pphysch 2y ago
The flexibility of JSON is a downside when you just want to stream large volumes of row-oriented tabular data
- hajile 2y agoIf you want to stream large volumes of row-oriented data, you aren't reading yourself and you should be using a binary format which is going to be significantly smaller (especially for numeric data).
- pphysch 2y agoYeah that would be the next step in optimization. In the meanwhile, raw text CSV streaming (for not purely numeric data) is still extremely fast and easy to set up