I built a data processing framework at GE that let junior devs write whatever code they needed to transform a particular input. It provided an interface that th

I built a data processing framework at GE that let junior devs write whatever code they needed to transform a particular input. It provided an interface that they had to satisfy (for data lineage metrics) but otherwise scaled their code without them having to understand the distributed architecture or anything about the platform. Exceptions flowed up to the platform and became part of the data lineage metrics. I walked into 20 years of adhoc code that had zero data lineage, recoverability, or scalability that was breaking daily. There were contractors with over a decade of tenure whose job it was to troubleshoot and fix their own brittle processes (and make new ones) daily. I got laid off (747Max plus pandemic) as I was rolling it out and they went back to the old way. Subsequently, a new startup (Pantomath) emerged with former GE engineers (and other former colleagues of mine) from my former department to address that problem domain. Based on my experience trying to socialize this type of solution, sales are going to be a bitch.