glapark

4 ms·

1. 1.▲
   by glapark 6y ago

   Shuffling in Spark works well for small datasets, but is not reliable for large datasets because fault tolerance in Spark is incomplete. For example, check this Jira: https://issues.apache.org/jira/browse/SPARK-201
2. 2.▲
   by glapark 7y ago

   I guess my question was a bit unclear. We state upfront that our product is not open source because it is shipped with a proprietary part. It just builds on an open-source project.
3. 3.▲
   Ask HN: More open than open source products

   2 points by glapark 7y ago|4 comments