3 ms·
If I implement what’s described in the Delta Lake paper, will I be able to query and update arbitrary Delta Lake tables as populated by Databricks in 2025? (Wo
by twoodfin 1y ago
If I implement what’s described in the Delta Lake paper, will I be able to query and update arbitrary Delta Lake tables as populated by Databricks in 2025?
(Would be genuinely excited if the answer is yes.)
- eatonphil 1y agoNot sure (probably not). But it's definitely much easier to immediately understand IMO.
- twoodfin 1y agoOK, but at least from my perspective, the point of OTF’s is to allow ongoing interoperability between query and update engines. A “standard” getting semi-monthly updates via random Databricks-affiliated GitHub accounts doesn’t really fit that bill. Look at something like this: https://github.com/delta-io/delta/blob/master/PROTOCOL.md#writer-requirements-for-clustered-table https://github.com/delta-io/delta/blob/master/PROTOCOL.md#wr... Ouch.