Validation Metric

Definitions

1. A metric calculated on validation data to assess whether a model is improving in the ways that matter for the task. Validation metrics help teams decide when to stop, compare runs, or promote a checkpoint.

   In plain English: A metric measured on validation data to judge model quality.

   Example: "Accuracy was not enough, so they added a domain-specific validation metric for citation correctness and formatting compliance."

Related Terms

• AI Metric
• Goodhart's Law AI
• Hallucination Rate
• Model Metric
• Model Validation
• Token Count
• Uncertainty Quantification
• Validation Loss