Our implementation of the Merkle DAG data structure is optimized for tabular data since Dolt is a SQL database, but a lot of it generalizes to other kinds of da

Our implementation of the Merkle DAG data structure is optimized for tabular data since Dolt is a SQL database, but a lot of it generalizes to other kinds of data. For example, we put a lot of work into making sure that chunk sizes had a predictable distribution, since very large chunks kill query performance: https://www.dolthub.com/blog/2022-06-27-prolly-chunker/ https://www.dolthub.com/blog/2022-06-27-prolly-chunker/ We also have a lot of work to do with preserving structural sharing across schema changes, which we're not great at yet. https://www.dolthub.com/blog/2024-01-19-structural-sharing-with-schema-changes/ https://www.dolthub.com/blog/2024-01-19-structural-sharing-w...