---
title: "What is faithfulness in RAG and LLM evaluation?"
description: "Faithfulness measures whether every claim in an LLM answer is supported by the retrieved context. Learn how it is scored and how it differs from correctness."
type: "glossary-term"
canonical_url: "https://theaiengineering.com/glossary/faithfulness"
markdown_url: "https://theaiengineering.com/glossary/faithfulness.md"
topic: "LLM evaluation and observability"
author: "The AI Engineering Editors"
publisher: "The AI Engineering"
updated: "2026-11-06"
keywords: ["Faithfulness","groundedness","answer faithfulness","faithfulness metric"]
citation: "The AI Engineering Editors. \"What is faithfulness in RAG and LLM evaluation?\" The AI Engineering, updated Nov 06, 2026. https://theaiengineering.com/glossary/faithfulness"
---

# What is faithfulness in RAG and LLM evaluation?

Also called groundedness, answer faithfulness, faithfulness metric.

> **Definition of Faithfulness:** Faithfulness is an evaluation metric that measures what share of the claims in a generated answer can be inferred from the context the model was given, usually scored from 0 to 1.

Faithfulness is a measure of whether a generated answer sticks to the context the model was given. An answer is faithful when every claim in it can be inferred from the retrieved passages, documents, or tool results in the prompt. Evaluation frameworks for [retrieval-augmented generation](https://theaiengineering.com/glossary/retrieval-augmented-generation) score it alongside retrieval metrics, because it separates a model that invents details from a retriever that fetched the wrong text. Some tools call the same idea groundedness.

## How faithfulness is scored

Faithfulness is scored by splitting an answer into individual claims and checking each claim against the retrieved context. The score is the number of supported claims divided by the total number of claims, from 0 to 1. A score of 1 means every claim is backed by the context; 0.5 means half the claims have no support there.

The [Ragas paper](https://arxiv.org/abs/2309.15217) (Es et al., 2023) defined the metric for RAG pipelines in two steps. First, an LLM breaks the answer into short statements. Second, an LLM decides for each statement whether the context supports it. Faithfulness is the supported share. The authors tie the metric to avoiding [hallucinations](https://theaiengineering.com/glossary/hallucination) and to making the retrieved context a justification for the answer.

The [Ragas documentation](https://docs.ragas.io/en/stable/concepts/metrics/available_metrics/faithfulness/) gives a worked example. Asked where and when Einstein was born, with context that gives his birth date as March 14, 1879, an answer stating he was born in Germany on March 20, 1879, contains two claims. The birthplace is supported and the date is not, so faithfulness is 0.5. The same page offers HHEM-2.1-Open, a small open classifier from Vectara, as an alternative to an LLM for the claim check.

Because faithfulness needs only the question, the context, and the answer, it requires no reference answer. That makes it usable on production traffic, where an [LLM-as-a-judge](https://theaiengineering.com/glossary/llm-as-a-judge) can score a sample of live traces as [online evaluation](https://theaiengineering.com/glossary/online-evaluation). TruLens includes the same check, under the name groundedness, in its [RAG triad](https://www.trulens.org/getting_started/core_concepts/rag_triad/) with context relevance and answer relevance.

## Faithfulness vs correctness and hallucination

Faithfulness compares an answer with the retrieved context, correctness compares it with the truth or a reference answer, and hallucination names the failure. The two metrics can disagree. An answer can be faithful and wrong when retrieval returned an outdated document, and correct but unfaithful when the model relied on its own knowledge.

| | Faithfulness | Correctness |
|---|---|---|
| Compared with | Retrieved context | Reference answer or ground truth |
| Needs labeled data | No | Yes |
| Catches | Invented or unsupported claims | Wrong answers from any cause |
| Misses | Faithful answers built on bad sources | Claims the sources cannot back up |

A low faithfulness score points to the prompt or the model, which added claims the context does not contain. High faithfulness with low correctness points to retrieval: the model repeated what it was given, and what it was given was wrong or incomplete. Pairing faithfulness with a retrieval metric such as [recall@k](https://theaiengineering.com/glossary/recall-at-k) shows which stage failed.

An unsupported claim in a RAG answer is one kind of hallucination, but faithfulness does not detect every kind. It cannot flag a false statement that the retrieved documents also contain. The [LLM evaluation guide](https://theaiengineering.com/articles/llm-evaluation) covers how to calibrate faithfulness judges and gate releases on the score.

## Related terms

- [Hallucination](https://theaiengineering.com/glossary/hallucination): A hallucination is output from a language model that is fluent and plausible but factually false, unsupported by the provided sources, or invented outright, such as a fabricated citation or package name.
- [LLM-as-a-judge](https://theaiengineering.com/glossary/llm-as-a-judge): LLM-as-a-judge is an evaluation method in which a language model scores or compares the outputs of an LLM application against a rubric, a reference answer, or another response, replacing or supplementing human graders.
- [Retrieval-augmented generation (RAG)](https://theaiengineering.com/glossary/retrieval-augmented-generation): Retrieval-augmented generation (RAG) is a technique that retrieves relevant passages from an external knowledge source at query time and adds them to a language model's prompt so the answer is grounded in that data.
- [Recall@k](https://theaiengineering.com/glossary/recall-at-k): Recall@k is a retrieval metric that measures the fraction of a query's relevant documents that appear in the top k results, averaged over a set of test queries.
- [LLM evaluation](https://theaiengineering.com/glossary/llm-evaluation): LLM evaluation is the practice of measuring how well a language model or LLM-based application performs on defined tasks, using test datasets, automated graders, model-based judges, and human review.
- [Online evaluation](https://theaiengineering.com/glossary/online-evaluation): Online evaluation is the practice of scoring an LLM application's live production traffic, usually a sample of traces, with reference-free graders, policy checks, and user feedback to detect quality problems after release.

## Guides that cover faithfulness

- [What is retrieval-augmented generation (RAG)? How RAG works](https://theaiengineering.com/articles/what-is-rag): Retrieval-augmented generation (RAG) grounds LLM answers in your documents. Learn the RAG pipeline, hybrid search, agentic RAG, evaluation, and failure modes.
- [LLM evaluation: a practical guide to evals, metrics, and judges](https://theaiengineering.com/articles/llm-evaluation): LLM evaluation for engineers: build eval datasets, pick metrics, calibrate LLM-as-a-judge, evaluate RAG and agents, and gate every release in CI.
- [Chunking strategies for RAG: how to choose, tune, and evaluate them](https://theaiengineering.com/articles/chunking-strategies-for-rag): Chunking strategies for RAG compared: fixed-size, recursive, document-aware, semantic, parent-child, and late chunking, with tested Python and an eval method.
- [LLM observability: what to capture, which metrics, and tools](https://theaiengineering.com/articles/llm-observability): LLM observability guide: what to capture in traces and spans, metrics to track, OpenTelemetry GenAI conventions, tool categories, and keeping prompts private.

Part of the [LLM evaluation and observability](https://theaiengineering.com/topics/llm-evaluation) topic hub.

## Cite this definition

The AI Engineering Editors. "What is faithfulness in RAG and LLM evaluation?" The AI Engineering, updated Nov 06, 2026. https://theaiengineering.com/glossary/faithfulness

- Title: What is faithfulness in RAG and LLM evaluation?
- Author: The AI Engineering Editors
- Publisher: The AI Engineering
- Updated: 2026-11-06
- URL: https://theaiengineering.com/glossary/faithfulness
- Markdown: https://theaiengineering.com/glossary/faithfulness.md
