3 ms·
We are on Azure using Spark via Databricks. We had to abandon sci kit learn because of this choice. Does your service require AWS and can it be used in conjunct
by purple-again 7y ago
We are on Azure using Spark via Databricks. We had to abandon sci kit learn because of this choice. Does your service require AWS and can it be used in conjunction with Spark? Thank you for your time and consideration.
- pela 7y agoWe currently provide integrations with AWS (S3 and Batch) and it is easy to extend Metaflow to work with other cloud providers. https://docs.metaflow.org/internals-of-metaflow/technical-overview#decorators https://docs.metaflow.org/internals-of-metaflow/technical-ov...
- missosoup 7y agoWhat about databricks made you abandon sklearn?
- manojlds 7y agoMLLib I would think - https://spark.apache.org/docs/latest/ml-guide.html https://spark.apache.org/docs/latest/ml-guide.html
- rxin 7y agoWhat's the reason you need to abandon scikit-learn? You can run scikit-learn on Databricks, and many of our customers do. Disclaimer: Databricks cofounder.