I have been using https://datalust.co/ https://datalust.co/ to handle this. It scales really well down and up to how much you want to spend. It comes with exis

I have been using https://datalust.co/ https://datalust.co/ to handle this. It scales really well down and up to how much you want to spend. It comes with existing integrations with a lot of libraries and formats and a CLI to push data from file based logs to their service. They have just added a new parser and query engine written in Rust to get the best performance out of your instance. https://news.ycombinator.com/item?id=34758674 https://news.ycombinator.com/item?id=34758674