Flaky Test

Definitions

1. A test that intermittently passes and fails without any code change, typically due to race conditions, time dependencies, shared state, or network calls. Flaky tests erode confidence in the test suite and train developers to ignore failures. Often caused by non-deterministic ordering or timing.

   In plain English: A test that randomly passes or fails for no apparent reason, making the entire test suite unreliable.

   Example: "That test fails 10% of the time because it depends on the order other tests run — classic flaky test. Quarantine it until it's fixed."

Related Terms

• Integration Testing
• SAST
• Nightly Build
• Matrix Build
• Regression Test
• Suite
• Test Coverage
• Test Runner
• Test Suite
• Visual Regression Test