3 ms·
Your comment made me smile because Apache Beam is one of my favorite tools, but it seems nobody outside Spotify has had heard of it. The bitwise operation dund
by pyuser583 6y ago
Your comment made me smile because Apache Beam is one of my favorite tools, but it seems nobody outside Spotify has had heard of it.
The bitwise operation dunder methods have no definition outside of integers. So they’re basically freebies to do what you want with.
Honestly I think the Apache Beam API makes a lot of sense.
- pushingice 6y agoThis is because it started out as a Google project. There is an internal time-series framework there called Monarch that does the same thing for composing operations.
- heavyset_go 6y agoI have to agree with this sentiment.
- red_hare 6y agoTo be clear, I love Beam. It runs all of my startups stream and batch processing. I just think the Java API's version... pipeline = pipeline .apply("FirstTransform, MyFirstParDo()) .apply("SecondTransform, MySecondParDo()) is much clearer than the Python version... pipeline = ( pipeline | "FirstTransform" >> MyFirstParDo() | "SecondTransform" >> MySecondParDo() )
- pyuser583 6y agoAgreed. I prefer the Java version, for a number of reasons. Scio is even better. But the bitwise operations make sense python wise.