Might want to look at purpose built tools for that such as lakeFS (https://github.com/treeverse/lakeFS/ https://github.com/treeverse/lakeFS/) * Disclaimer: I'm

Might want to look at purpose built tools for that such as lakeFS (https://github.com/treeverse/lakeFS/ https://github.com/treeverse/lakeFS/) * Disclaimer: I'm one of the creators/maintainers of the project.