3 ms·
Minio and nifi, require lots of resources for themselves. Better off using pure python and if one wants something lighweight and visually pleasing Mara [0] or D
by antman 6y ago
Minio and nifi, require lots of resources for themselves. Better off using pure python and if one wants something lighweight and visually pleasing Mara [0] or Dagster with Dagit [1] will do the job
[0] https://github.com/mara/mara-pipelines https://github.com/mara/mara-pipelines
[1] https://docs.dagster.io/tutorial/execute https://docs.dagster.io/tutorial/execute
- ekianjo 6y agoYes, Minio and Nifi are not lightweight but if you look for robustness they have been used in large environments and proven to scale.