RAG Evaluation

Definitions

1. The evaluation of retrieval-augmented generation systems across dimensions such as retrieval relevance, grounding, citation quality, answer correctness, and latency. RAG evaluation usually needs to inspect both retrieval and generation, not just the final answer.

   In plain English: Testing how well a retrieval-augmented generation system performs.

   Example: "Their RAG evaluation caught a retrieval bug that final-answer scoring alone would not have surfaced."

Related Terms

• AI Evaluation
• Elicitation
• Evaluation Harness
• Faithfulness
• LLM Judge
• Needle in a Haystack
• Proxy Task
• RAG Architecture
• RAG Chain
• RAG Chunk
• RAG Context
• RAG Embedding
• RAG Index
• RAG Pipeline
• RAG Retriever
• Self-Evaluation