3 ms·
I'm not going to answer this for my current company, but man was it a mess at my last one. I was involved in writing custom ETL tooling and attempting to onboar
by nonameiguess 6y ago
I'm not going to answer this for my current company, but man was it a mess at my last one. I was involved in writing custom ETL tooling and attempting to onboard product management teams to using it. Financial data was all stored in APEX, which could only be queried using Windows APIs, so the one guy we had who knew Visual Basic did all of that. I wrote a bunch of Python libraries that defined a custom intermediate format for data extracted from Jira, Rational Team Concert, and Azure DevOps boards, since there was no consistent standard for what product teams actually used but it tended to be one of those three things. We offered the ability to feed the data to InfluxDB and visualize it in Grafana via automation provided by ansible that would deploy the DB, dashboards, and configuration for the custom ETL tools together so they were in sync with each other. That was for on-premises single team usage.
For enterprise, company-wide aggregation, we were supposed to be feeding an enterprise measures system with long term storage in Amazon Redshift and standardized dashboards built in PowerBI that utilized standard metrics definitions everyone was supposed to converge on. But that product was two years behind schedule and eventually cancelled when the company merged with an airline manufacturer and Covid hit a month later and suddenly capital funds totally dried up. So luckily our on-premises solution was entirely free and allowed user to define whatever collection strategies and metrics they wanted.
I hope someone is still actually using this. It was just me and two other guys who made all this tooling and automation and deployed it to seven pilot product teams middle of last year. Not sure how they're doing without me since I wrote all of the core libraries myself with no external input or review because we were in such a hurry to demonstrate value.