9 ms·

I've used the similar Apache beam project before. https://beam.apache.org https://beam.apache.org I mainly used their java libraries, but the python binding ha

• ccygoogle 9y ago
  We recently checked in streaming support in Beam Python here: https://lists.apache.org/thread.html/82f5b5d2ab2ddd3849584f6dfe4128cbd551b10cc0864cae6701d3fc@<dev.beam.apache.org> https://lists.apache.org/thread.html/82f5b5d2ab2ddd3849584f6... You can take a look at and run the streaming wordcount example in Beam: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/streaming_wordcount.py https://github.com/apache/beam/blob/master/sdks/python/apach... In addition to the available local execution, Google also offers running Beam pipelines as a managed service in Cloud Dataflow (https://cloud.google.com/dataflow/ https://cloud.google.com/dataflow/). Python streaming is in private alpha--contact us at dataflow-python-feedback@google.com if you'd like to try it out. Note: I work for Google on Apache Beam and Cloud Dataflow.
  • jimktrains2 9y ago
    I used Google Cloud Dataflow at a previous job. I really did like it and feel like Beam is set up pretty well. Thanks!