4 ms·
mpipe might also be of interest. http://vmlaker.github.io/mpipe/ http://vmlaker.github.io/mpipe/
by TBastiani 8y ago
mpipe might also be of interest.
http://vmlaker.github.io/mpipe/ http://vmlaker.github.io/mpipe/
- cgarciae 8y agoThanks! Did take a look at mpipe (its actually referenced in the readme). But mpipe has its flaws: 1. It uses None as the stage terminator, this is VERY error prone, what if you actually want to send None? Pypeline uses a special private terminator. 2. You have to first manually put all the data into the pipe in a for-loop and then manually get it out. In Pypeline all this is simplified: it consumes iterables and all stages are iterables, so its 100% compatible with any function/framework that accepts iterables.
- cgarciae 8y ago3. If you first have to put in all the data first you cant handle streams. Pypeline accepts non-terminating iterables and also gives you back possibly non-terminating iterables.