3 ms·
If you're interested in this kind of stuff in python, you should check out datastreams: https://github.com/StuartAxelOwen/datastreams https://github.com/StuartA
by stuartaxelowen 11y ago
If you're interested in this kind of stuff in python, you should check out datastreams: https://github.com/StuartAxelOwen/datastreams https://github.com/StuartAxelOwen/datastreams
- msellout 11y agoWhy is `datastreams` better than using generators and comprehensions, plus the itertools module in the standard library?
- stuartaxelowen 11y agoIt makes working with iterators easy - this way you're always talking about one thing at a time, instead of the whole collection/iterator, making efficient computation easy. Also, the abstraction allows for optimizations like delegating to Apache Spark or other processes/threads.