What is a reasoning model in AI? Reasoning vs LLMs

Also called large reasoning model, LRM, thinking model

Definition

A reasoning model is a large language model trained, usually with reinforcement learning, to generate intermediate reasoning tokens before its final answer, spending more inference compute to solve multi-step problems.

A reasoning model is a large language model that works through a problem in an extended chain of thought before it commits to an answer. OpenAI's o1, announced on September 12, 2024, brought the approach to a commercial API. DeepSeek-R1 followed in January 2025 with open weights, and Anthropic's Claude 3.7 Sonnet, released in February 2025, was a hybrid model that could answer directly or generate extended reasoning first. Current OpenAI and Anthropic APIs both expose controls for how much a model reasons.

How reasoning models work#

Two ideas combine: training the model to reason, and letting it spend more compute on hard problems at inference time.

  • Training. Reinforcement learning rewards the model for reaching correct answers on problems that can be checked automatically, an approach often called reinforcement learning with verifiable rewards (see RLHF). The DeepSeek-R1 paper reports that rule-based rewards for answer accuracy and output format, applied at scale, produced behaviors such as self-verification and reflection without human-written reasoning examples.
  • Inference. The model generates more tokens of reasoning on harder problems. OpenAI reported that o1's performance improved both with more reinforcement learning during training and with more compute spent on reasoning at test time.

APIs expose a control for this trade-off, such as OpenAI's reasoning.effort parameter or Anthropic's effort setting. According to OpenAI's reasoning guide, reasoning tokens are billed as output tokens and occupy context window space even though the API does not return them.

Reasoning models vs standard LLMs#

Standard LLM Reasoning model
Output Answer directly Reasoning tokens, then the answer
Time to first token of the answer Low Higher, and grows with reasoning length
Cost per request Lower Higher, since reasoning is billed as output
Strongest on Chat, rewriting, extraction, lookups Math, code, multi-step planning, agents

Reasoning models are not the right choice for every request. For simple lookups, classification, or latency-sensitive chat, a standard model or a low effort setting is usually the better fit. Reasoning ability can also be distilled into smaller models: DeepSeek fine-tuned Qwen and Llama models from 1.5B to 70B parameters on DeepSeek-R1 outputs. For more depth, see the reasoning models explainer and the LLM benchmarks explainer.

Cite this definition

The AI Engineering Editors. "What is a reasoning model in AI? Reasoning vs LLMs." The AI Engineering, updated Nov 06, 2026. https://theaiengineering.com/glossary/reasoning-model

Title
What is a reasoning model in AI? Reasoning vs LLMs
Author
The AI Engineering Editors
Publisher
The AI Engineering
Updated
View as Markdown

Part of the LLM models and benchmarks hub · Updated