This is the main insight I got: >the original architecture was based on a tool that was not designed for scale. Based on the article, it read as if this tool w

This is the main insight I got: >the original architecture was based on a tool that was not designed for scale. Based on the article, it read as if this tool was used for diagnostics to perform ad-hoc assessments of stream quality. This means it likely wasn’t designed for scale or put through the pressure tests of a formal design document / review. If that were to happen, any run of the mill Software Engineer would have been able to recognize the obvious scaling / cost bottlenecks that would be encountered. Lesson learned: ensure your design is sane before turning your PoC into a full blown production system.