4 ms·
Ask HN: Do you use S3/R2 as a data lake?
Curious to learn HN's opinion, what is your number 1 use case? What kind of queries do you perform?
- sgt101 4y agoI use it (and GCS) as staging storage. When we bring in data it often ends up on the block store before it gets stuffed in BQ or Redshift or whatever Spark alike we are using at the time.
- greatNespresso 4y agoThanks a lot! If I may ask, how do you prepare the data to be ingested in BQ, Redshift or the likes?
- sgt101 4y agoWell - formatting, cleaning transformation to be in the right schema, perhaps enrichment