AI Test

Definitions

1. A single test case or evaluation scenario used to check whether an AI system behaves acceptably on a specific input or requirement. AI tests can cover factuality, formatting, safety, latency, tool use, or other important behaviors.

   In plain English: One test case used to evaluate an AI system.

   Example: "They added an AI test for ambiguous refund requests after a bad prompt change started misclassifying them."

Related Terms

• AI Quality
• AI Simulation
• AI Testing
• Data Quality
• Model Quality
• Model Test
• Prompt Testing
• Quality Filter
• Regression in AI
• Response Quality
• Verification AI
• Code Testing Culture
• Testing Standard