If you really need "real-time-ness" TSDB will probably not work. You could go with sparkstreaming or flink but for that amount that will be overkill. Kafka sca

If you really need "real-time-ness" TSDB will probably not work. You could go with sparkstreaming or flink but for that amount that will be overkill. Kafka scales quite nicely and is relativly easy to operate (compared to spark etc). But thats only if you really need to scale, for your current usage even kafka is a bit overkill.