4 ms·
Because if your topics' throughput is low (say <1000 per sec), all those tools might be overkill as most of them require a new cluster, significant setup and us
by alienreborn 8y ago
Because if your topics' throughput is low (say <1000 per sec), all those tools might be overkill as most of them require a new cluster, significant setup and using new framework. This library might help quickly build consumers with little to no extra setup/infra.
Also, Robinhood using this in production says this performs reasonably well and battle tested to handle some operations behind a popular app such as theirs.
Definitely excited to try this out to see how this fares compared to Kafka Streams and Spark Structured streaming, both of which we use.
- vineetgoel1992 8y agoNot having to use systems such as Yarn/Mesos was a big motivation for us. Faust works well with any existing deployment systems (we currently use supervisor with EC2 instances) you may have and definitely made it easy for teams to start building/deploying apps. Further since Faust is a library, it can work with any existing python projects/tools - we use it both independently and alongside Django.