3 ms·
what is alternative to MLflow other than SQLite, like Kubeflow, Metaflow?
by praveenhm 4y ago
what is alternative to MLflow other than SQLite, like Kubeflow, Metaflow?
- farbarg 4y agoThere are a lot of tools in this space. Shameless plug to follow. I helped build and use Disdat, which is a simple data versioning tool. It notably doesn't have the metadata capture libraries MLFlow has for different model libs, but it's meant to a lower-layer on which that can be built. Thus you won't see particulars about tracking "models" or "experiments", because models/experiments/features/intermediates are all just data thingies (or bundles in Disdat parlance). For the last 2+ years we've used Disdat to track runs and outputs of a custom distributed planning tool, and used Disdat-Luigi (an integration of Disdat with Luigi to automatically consume/produce versioned data) to manage model training and prediction pipelines (some with 10ks of artifacts). https://disdat.gitbook.io/disdat-documentation https://disdat.gitbook.io/disdat-documentation
- crucialfelix 4y agoWeights and Balances https://wandb.ai/site https://wandb.ai/site
- pcerdam 4y agoWeights and *Biases :)
- kuba_dmp 4y agoneptune.ai https://neptune.ai/ https://neptune.ai/
- the83 4y agoComet: https://www.comet.com/site/ https://www.comet.com/site/
- mmq 4y agohttps://github.com/polyaxon https://github.com/polyaxon
- kumare3 4y agoCheckout Flyte.org and it’s sibling project https://www.union.ai/unionml https://www.union.ai/unionml
- d4rkp4ttern 4y agoI highly recommend ClearML for effortless experiment that just works. It does a lot more of MLOps besides experiment tracking but I haven’t used those functionalities https://clear.ml/ https://clear.ml/ I had researched and spent time with several other tools including DVC, GuildAI and MLFlow but finally settled on ClearML. WandB pricing is too aggressive for my liking (they force an annual subscription of $600 last I checked)