3 ms·
We recently checked in streaming support in Beam Python here: https://lists.apache.org/thread.html/82f5b5d2ab2ddd3849584f6dfe4128cbd551b10cc0864cae6701d3fc@<dev
by ccygoogle 9y ago
We recently checked in streaming support in Beam Python here: https://lists.apache.org/thread.html/82f5b5d2ab2ddd3849584f6dfe4128cbd551b10cc0864cae6701d3fc@<dev.beam.apache.org> https://lists.apache.org/thread.html/82f5b5d2ab2ddd3849584f6...
You can take a look at and run the streaming wordcount example in Beam: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/streaming_wordcount.py https://github.com/apache/beam/blob/master/sdks/python/apach...
In addition to the available local execution, Google also offers running Beam pipelines as a managed service in Cloud Dataflow (https://cloud.google.com/dataflow/ https://cloud.google.com/dataflow/). Python streaming is in private alpha--contact us at dataflow-python-feedback@google.com if you'd like to try it out.
Note: I work for Google on Apache Beam and Cloud Dataflow.
- jimktrains2 9y agoI used Google Cloud Dataflow at a previous job. I really did like it and feel like Beam is set up pretty well. Thanks!