4 ms·
and I, while dealing with the fallout of migrating something from AWS Data Pipeline (it entered "Maintenance Mode" and they removed console access earlier this
by mh- 3y ago
and I, while dealing with the fallout of migrating something from AWS Data Pipeline (it entered "Maintenance Mode" and they removed console access earlier this year.)
- hughesjj 3y agoData pipelines was also a perennial shit show behind the scenes. Turns out integration is a lot of complexity even if the service is "simple" in concept and doesn't need to be so real time. I feel like data pipelines and swf have been replaced by step functions+event bus+lambdas/fargate. We've furthered abstractions over time, and that's a good thing. Edit that said no idea how they scale in comparison