10 ms·
Looks similar to what tf.data does for Tensorflow
by make3 8y ago
Looks similar to what tf.data does for Tensorflow
- cgarciae 8y agoNice to hear that. When I wrote this: "Pypeline was designed to solve simple medium data tasks that require concurrency and parallelism but where using frameworks like Spark or Dask feel exaggerated or unnatural." it was actually because I've resorted / hacked into tf.data and Dask in the past just to get concurrency and parallelism. Pypeline is way more natural for pure python stuff.