3 ms·
If you really need to work with large data files 1mb+. Json is a terrible format. You should look into flat buffers. It’s like having indexed json where there i
by nojvek 7y ago
If you really need to work with large data files 1mb+. Json is a terrible format. You should look into flat buffers. It’s like having indexed json where there is no parsing cost. You can have millions of rows and nested objects and it will only read the bytes it needs.
It is length prefix encoded format so it’s pretty safe to work in a streaming manner too.
- smileypete 7y agoGood article on how Facebook used them for their mobile app: https://code.fb.com/android/improving-facebook-s-performance-on-android-with-flatbuffers/ https://code.fb.com/android/improving-facebook-s-performance...