2 ms·
Another option, that manages versioning of your computational graph and its results and provides extremely elegant query-able memoization is Mandala https://git
by krastanov 3y ago
Another option, that manages versioning of your computational graph and its results and provides extremely elegant query-able memoization is Mandala https://github.com/amakelov/mandala https://github.com/amakelov/mandala
It is a much simpler and much more magical piece of software that truly expanded how I think about writing, exploring, and experimenting with code. Even if you never use it, you probably would really enjoy reading the blog posts the author wrote about the design of the tool https://amakelov.github.io/blog/pl/ https://amakelov.github.io/blog/pl/
- ianandrich 3y agoWow. What a quality tool. Thanks for sharing!
- amakelov 3y agoAuthor here - thank you for the compliment! Always happy to answer any questions (the docs are admittedly quite sparse) and hear about what people like/dislike about the library!
- esafak 3y agoLineage-aware pipeline orchestration frameworks handle this. This is an important feature I judge frameworks by. https://www.dolthub.com/blog/2021-06-04-flyte-dolt-plugin/ https://www.dolthub.com/blog/2021-06-04-flyte-dolt-plugin/ https://cloud.google.com/vertex-ai/docs/pipelines/configure-caching https://cloud.google.com/vertex-ai/docs/pipelines/configure-... https://docs.aws.amazon.com/sagemaker/latest/dg/pipelines-caching.html https://docs.aws.amazon.com/sagemaker/latest/dg/pipelines-ca... https://docs.aws.amazon.com/sagemaker/latest/dg/querying-lineage-entities.html https://docs.aws.amazon.com/sagemaker/latest/dg/querying-lin...