3 ms·
Interesting. What do you mean when you say: "versus the authors re-applying some of same research in their own thing." And does "code distribution" just mean t
by richardliaw 7y ago
Interesting. What do you mean when you say: "versus the authors re-applying some of same research in their own thing."
And does "code distribution" just mean to release as open source?
- choppaface 7y agocode distribution I mean like cloudpickle. Which Ray has, but I wonder about an equivalent to Spark files (torrented and cached). A Kubernetes runner is also important ... I wish the Ray peeps would consider just trying to merge some with the Spark RDD API. Reynold (at Databricks) is kinda hard to deal with, but so far to me it looks like the aim of having Ray team build things from the ground up has simply re-validated a lot of the systems work (but not all) that’s already in Spark.