3 ms·
afaiu appending to parquet files is not cheap, you basically have to re-write the file. Do you mean periodically flushing a queue of logs into a new parquet fi
by tosh 2y ago
afaiu appending to parquet files is not cheap, you basically have to re-write the file.
Do you mean periodically flushing a queue of logs into a new parquet file (e.g. named with a timestamp)?