3 ms·
You're absolutely right that that's confusing. Short answer: We just wanted to release this as soon as possible and haven't gotten to it yet. Slightly longer
by brancz 4y ago
You're absolutely right that that's confusing.
Short answer: We just wanted to release this as soon as possible and haven't gotten to it yet.
Slightly longer answer: We currently build parquet buffers in-memory which we are soon going to persist. We still want to finish up some details about how we partition and compact data over time before we do that though. We've learned from previous projects that once we write to disk people start to depend on that :)