p-value

Definitions

1. The probability of obtaining results at least as extreme as the observed data, assuming the null hypothesis is true. A small p-value (typically below 0.05) suggests the observed effect is unlikely to be due to chance alone. Widely used in A/B testing and scientific research, though frequently misinterpreted as the probability that the hypothesis is wrong.

   In plain English: A number that tells you how likely your result happened by pure luck. A very small p-value means your result is probably real, not just a coincidence.

   Example: The marketing team got excited about a 12% lift in click-through rate, but the p-value was 0.34 — not even close to significant with their sample size.

Related Terms

• Latency
• Throughput
• tail latency
• A/B testing
• correlation
• regression
• Cross-Validation
• Gaussian Mixture Model