3 ms·
How do dependencies work in this type of data lakehouse? Does the orchestration layer handle that or is there metadata within the data lake that provides compl
by mulmen 3y ago
How do dependencies work in this type of data lakehouse? Does the orchestration layer handle that or is there metadata within the data lake that provides completeness information?
- 392 3y agoIt doesn't, maybe you mean something like Dagster or Airflow managing insertion time dependcies? Although iceberg does provide transactions across tables I believe.