2 ms·
Ask HN: which datastore for large log files
I am working with systems that are generating 14TB of log files per day and I would like to consume them in a datastore so that I can run ad hoc queries on this data.
Since these are log files they are highly compressible (especially if compressed in a columnar fashion). What systems do people recommend for this type of system?
I'd prefer an open source solution if there's one out there.