Many companies I know try to use Agile/Scrum for data pipelines, and focus heavily on getting a customer-ready prototype. This is then often really difficult to

Many companies I know try to use Agile/Scrum for data pipelines, and focus heavily on getting a customer-ready prototype. This is then often really difficult to scale, because bad architectural assumptions have been baked into the project. In general I see most companies/teams picking on methodology and staying with it, rather than adapting to the project.