2 ms·
If I understand correctly, Parseable is relying heavily on DataFusion for its SQL implementation: 1/ I know that Parquet and Arrow are very good for time serie
by ngrilly 4y ago
If I understand correctly, Parseable is relying heavily on DataFusion for its SQL implementation:
1/ I know that Parquet and Arrow are very good for time series (mostly metric names, labels, timestamps and real values), but are they good for strings, which are quite important in logs?
2/ Is DataFusion able to execute an SQL request over a large number of large Parquet files without loading everything in memory at the same time, or can it process a Parquet as it reads it, in a streaming fashion?