3 ms·
Yeah, it does all those things, as long as you write all the code, set up all the systems for it to interact with, and manage all the logic yourself. That's lik
by gipp 9y ago
Yeah, it does all those things, as long as you write all the code, set up all the systems for it to interact with, and manage all the logic yourself. That's like saying Python does all those things.
- nl 9y agoIt's not exactly clear that Michelangelo does anything different? A quote: We provide containers and scheduling to run regular jobs to compute features which can be made private to a project or published to the Feature Store (see below) and shared across teams, while batch jobs run on a schedule or a trigger and are integrated with data quality monitoring tools to quickly detect regressions in the pipeline–either due to local or upstream code or data issues. That certainly sounds like you write code to run inside the containers. The deep integration with the standardized feature store etc sounds nice, but not radically different. we created a DSL (domain specific language) that modelers use to select, transform, and combine the features that are sent to the model at training and prediction times. The DSL is implemented as sub-set of Scala. So this is pretty much the equivalent of Spark Dataset API, or maybe the RFormula stuff in Spark ML[1] except in Scala right? [1] https://spark.apache.org/docs/latest/ml-features.html#rformula https://spark.apache.org/docs/latest/ml-features.html#rformu...