Topic hub 05

LLM evaluation and observability

Measuring whether LLM systems work, before and after they ship.

Overview

LLM evaluation measures whether a model-based system produces acceptable outputs for its task; LLM observability records what the system actually did in production so failures can be found and explained. Together they replace intuition with evidence.

This hub covers offline and online evals, judge models and their biases, tracing standards, the metrics worth tracking, and the categories of tooling available.

LLM evaluation and observability guides

Key terms

Full glossary

Tools and platforms

Platform directory

Other topics