All of your arguments are great, for why you need to treat observability as a core product feature and tie it to core product features. Engineers need to be se

All of your arguments are great, for why you need to treat observability as a core product feature and tie it to core product features. Engineers need to be serving the orgs goals, and one of the best ways to do that is to give them incentive and tooling to be thinking about the same things the product owner is. Have them build metrics for business metrics. Those are the things you should be alerting on, and to the extent you alert on technical pieces it should be in the service of those business metrics; don't alert on latency because it's an arbitrary goal, alert on latency because you can see how it affects user experience.