3 ms·

What do you mean by “not 24/7”? Why would a data lake go offline?

• pantsforbirds 2y ago
  It's pretty common to run analytics workloads on a fixed schedule. I've setup anlaytics workflows that ingest data every day/week/quarter and generate a report once a day. With workflows like that something like DuckDB can be amazing
• jakozaur 2y ago
  It is very common that the majority of work happens during business hours. In some setups it's easy. It's better to get beefy instance during that time and avoid having it running all the time.
• dimaor 2y ago
  not sure, but maybe it's possible only to update the model in a specific time? are there other uses to the data apart from learning and validation?
• creshal 2y ago
  Probably in the sense of "you're only running the really heavy analytics queries once a day/week/month", and thus don't constantly need the 24TB instances.