Canary Analysis

Definitions

1. Automated statistical comparison between a canary deployment (new version, small traffic percentage) and the baseline (current version) to detect regressions before full rollout. Compares error rates, latency percentiles, and business metrics. Tools like Kayenta (Netflix/Google) automate the pass/fail decision.

   In plain English: Automatically comparing the performance of a new deployment against the current version to catch problems before rolling out to everyone.

   Example: "Canary analysis compared p99 latency between the new and old versions over 30 minutes — the 15% regression triggered an automatic rollback."

Related Terms

• Idempotent
• Canary Deployment
• blue-green deployment
• canary release
• blast radius
• Prometheus
• Health Check
• LLMOps