4 ms·
I have to confess I don’t know what a data lake is. Halfway between a data puddle and a data ocean? There’s a lot of terms in this industry that you can avoid i
by pavlov 3y ago
I have to confess I don’t know what a data lake is. Halfway between a data puddle and a data ocean? There’s a lot of terms in this industry that you can avoid if you don’t work on that specific subset of functionality.
I do wonder if the marketing data from a 150-person org wouldn’t fit on a good old-fashioned database server. No need to get your feet wet.
- icedchai 3y agoBased on my own personal experience, a data lake is more of a data dumpster fire: a bunch of CSV, XML, or JSON files in random directories (typically in cloud object storage like S3 or a clone) plus sort of system that processes that data (Amazon Athena, Spark, Hadoop, DuckDB, whatever) to generate reports. In some projects I've seen, the size of the "lake" has been vastly over stated and could be stored in RAM on any modern system.
- deleted 3y ago[deleted]
- oxryly1 3y agoI think it’s time to bring back the term “databank”.
- pavlov 3y agoMaybe it's time to watch "Overdrawn at the Memory Bank" again: https://www.youtube.com/watch?v=UVo0dyjnWYo https://www.youtube.com/watch?v=UVo0dyjnWYo