3 ms·
We use lambda in our production environment for ETL. It works really well. In our case when we were using it, we modeled the code to account for 15 minute windo
by ignorantguy 5y ago
We use lambda in our production environment for ETL. It works really well. In our case when we were using it, we modeled the code to account for 15 minute window. Hope that helps.
- 91dylwyn 5y agoAre you finding any pain points? How did you manage the 15 minute window in case of large amounts of data running over time? How do you manage the DAGs on it? For example creating dependencies between tasks and monitoring and rerunning tasks?