4 ms·
Data warehouse: bundles compute & storage and comes at a comparatively high price point. Great option for certain workflows. Not as great for scaling & non-SQ
by MrPowers 4y ago
Data warehouse: bundles compute & storage and comes at a comparatively high price point. Great option for certain workflows. Not as great for scaling & non-SQL workflows.
Data lake: typically refers to Parquet files / CSV files in some storage system (cloud or HDFS). Data lakes are better for non-SQL workflows compared to data warehouses, but have a number of disadvantages.
Lakehouse storage formats: Based on OSS files and solve a number of data lake limitations. Options are Delta Lake, Iceberg, and Hudi. Lakehouse storage formats offer a ton of advantages and basically no downsides compared to Parquet tables for example.
Lakehouse architecture: An architectural paradigm to store data in a way such that's it's easily accessible for SQL-based and non-SQL-based workflows, see the paper: https://www.cidrdb.org/cidr2021/papers/cidr2021_paper17.pdf https://www.cidrdb.org/cidr2021/papers/cidr2021_paper17.pdf
There are a variety of tradeoffs to be weighed when selecting the optimal solution for your particular needs.
- marktangotango 4y agoIf this is satire it's brilliant. I don't doubt it's factual, but the last sentence is a slayer.
- fabatka 4y agoCan you explain why do you find the above explanation amusing? I honestly don't see the absurdity of it, although, my livelihood may depend on me not seeing it :)
- victor106 4y agoIt’s seems like you are just being negative to a reply that was meant to genuinely clarify confusing terminology. If not please elaborate why you doubt this is not factual?