How do you monitor data pipelines in production? What metrics and alerts would you set up?

Sample answer preview

Monitoring data pipelines ensures you detect and respond to problems before they impact downstream consumers. Good monitoring covers operational health, data quality, and business service levels. Operational metrics track whether pipelines run successfully.