4 ms·
That would explain why my ETLs are failing at 3am in the morning !!!
by sushshshsh 6y ago
That would explain why my ETLs are failing at 3am in the morning !!!
- FridgeSeal 6y agoYour ETL processes write to google drive or are dependent on email? Earnest question, don't mean to sound derisive.
- shrikant 6y agoI'm assuming some kind of workflow which uses email notifications, and only goes to the next step if the email notification succeeds..?
- nimchimpsky 6y agosounds horrific
- pirocks 6y agoMy understanding is part of google cloud failed(Google Cloud Storage), causing many outages, including but not limited to google drive/email.
- sushshshsh 6y agoUser emails file to drive script connects to drive and parses list of files within script copies files into redshift and moves original file to different directory or deletes it alas what can be done? this is what the company gets for building like this ^.^
- jwally 6y agoIf it makes you feel any better; same thing happened to me. Ugly Frankenstein process to get our data out of a third party vendor who can only e-mail us reports failed half-way through its run, and I was about to spend hours digging through to see why until I saw this.
- sushshshsh 6y agoHehehe.... my condolences... we're still trying to recover