Prompt Evaluation
Noun · AI & Machine Learning
Definitions
The process of measuring how well a prompt performs across relevant tasks, edge cases, and quality criteria. Prompt evaluation is important because prompts that look good on a few examples can fail badly in realistic traffic.
In plain English: Testing how well a prompt performs.
Example: "They blocked the rollout until prompt evaluation showed the new instructions improved groundedness without hurting latency too much."