Agent frameworks
An AI agent framework is a library that supplies the building blocks of an agent: a loop that calls a model, executes the tool calls it returns, manages state and memory, and coordinates multiple agents or workflow steps. A framework saves teams from writing that orchestration code from scratch.
The frameworks differ mainly in abstraction level and language. LangGraph, Microsoft Agent Framework, and Eino expose graphs or workflows with explicit state, CrewAI and AG2 organize teams of agents, and the OpenAI Agents SDK, Pydantic AI, and Strands Agents keep the core loop small. Agent toolkits such as the Claude Agent SDK, Deep Agents, and Letta ship an assembled agent with built-in tools.
Most entries are open source and provider-agnostic, and most connect to tools through the Model Context Protocol. Python has the widest choice, TypeScript teams can use Mastra, VoltAgent, or the Vercel AI SDK, and JVM, Go, and Rust developers have Spring AI, LangChain4j, Koog, Eino, and Rig. Microsoft has archived AutoGen and points Semantic Kernel users to Microsoft Agent Framework.
Agent frameworks compared
| Platform | Open source | Deployment | Best for |
|---|---|---|---|
| AG2 | Yes (Apache-2.0) | Library | Teams continuing AutoGen-style multi-agent patterns |
| Agno | Yes (Apache-2.0) | Library, Self-hosted | Running agents as services in your own cloud |
| BeeAI Framework | Yes (Apache-2.0) | Library | Python or TypeScript agents under open governance |
| CAMEL | Yes (Apache-2.0) | Library | Multi-agent research and synthetic data generation |
| Claude Agent SDK | No | Library | Agents that need file, shell, and code tools |
| Cloudflare Agents SDK | Yes (MIT) | Library, Managed cloud | Stateful agents hosted on Cloudflare |
| CrewAI | Yes (MIT) | Library | Role-based multi-agent collaboration in Python |
| Deep Agents | Yes (MIT) | Library | Long-horizon tasks that need subagents and a filesystem |
| DSPy | Yes (MIT) | Library | Optimizing LLM programs against measurable metrics |
| Eino | Yes (Apache-2.0) | Library | Go services that need agents and workflows |
| Genkit | Yes (Apache-2.0) | Library | App developers adding AI features across several languages |
| Google Agent Development Kit (ADK) | Yes (Apache-2.0) | Library | Agents deployed on Google Cloud |
| Haystack | Yes (Apache-2.0) | Library | Production RAG and agent pipelines in Python |
| Koog | Yes (Apache-2.0) | Library | Kotlin and JVM teams building agents |
| LangChain | Yes (MIT) | Library | Assembling agents from prebuilt integrations |
| LangChain4j | Yes (Apache-2.0) | Library | Java teams that want LangChain-style building blocks |
| LangGraph | Yes (MIT) | Library | Long-running agent workflows that need explicit control |
| Letta | Yes (Apache-2.0) | CLI, Self-hosted, Managed cloud, Library | Long-lived agents that keep and edit their own memory |
| LlamaIndex | Yes (MIT) | Library | Agents that work over documents and enterprise data |
| Mastra | Yes (Apache-2.0) | Library | TypeScript teams building agents into web apps |
| Microsoft Agent Framework | Yes (MIT) | Library | Python and .NET teams building on Azure |
| OpenAI Agents SDK | Yes (MIT) | Library | Minimal abstractions for multi-agent handoffs |
| Pydantic AI | Yes (MIT) | Library | Type-safe Python agents with validated structured output |
| Rig | Yes (MIT) | Library | Rust services that call LLMs and tools |
| Semantic Kernel | Yes (MIT) | Library | Maintaining existing Semantic Kernel applications |
| smolagents | Yes (Apache-2.0) | Library | Minimal code-writing agents and experiments |
| Spring AI | Yes (Apache-2.0) | Library | Spring Boot teams adding agents to Java services |
| Strands Agents | Yes (Apache-2.0) | Library | Model-driven agents on AWS or any other cloud |
| Vercel AI SDK | Yes (Apache-2.0) | Library | TypeScript web apps that stream model output to users |
| VoltAgent | Yes (MIT) | Library | TypeScript agents with built-in observability |
Profiles
AG2
ag2.ai
AG2 is an open-source Python framework for multi-agent systems from the creators of AutoGen, maintained by volunteers from several organizations; version 1.0 introduced a protocol-driven package and moved the classic ConversableAgent and GroupChat API to AG2 Classic.

Agno
agno.com
Agno is an open-source Python framework and agent platform: developers build agents, teams, and workflows with the Agno SDK and run them as durable services on AgentOS, which adds APIs, MCP, authentication, approvals, and scheduling in their own cloud.
BeeAI Framework
framework.beeai.dev
BeeAI Framework is an open-source framework for building multi-agent systems in Python and TypeScript, first released by IBM developers and now part of the Linux Foundation AI & Data program, with workflows and MCP and A2A integrations.

CAMEL
camel-ai.org
CAMEL is an open-source Python multi-agent framework from the CAMEL-AI community, built to study how agent systems scale, with components for synthetic data generation, world simulation, and task automation by cooperating agents.

Claude Agent SDK
Anthropic · code.claude.com
Anthropic's Claude Agent SDK exposes the agent loop, built-in tools, context management, and permission system behind Claude Code as a library in Python and TypeScript for building agents that edit files, run commands, and use MCP servers.

Cloudflare Agents SDK
Cloudflare · developers.cloudflare.com
Cloudflare's Agents SDK is an open-source TypeScript framework for agents that run on Cloudflare Workers, where each agent lives in a Durable Object with its own state, WebSocket connections, scheduling, and tools, including remote MCP servers.
CrewAI
crewai.com
CrewAI is an open-source Python framework for multi-agent workflows that combines Crews, groups of role-based agents that collaborate on a task, with Flows for event-driven control, plus a commercial control plane for deployment and monitoring.

Deep Agents
LangChain · docs.langchain.com
Deep Agents is LangChain's open-source agent toolkit built on LangGraph, with planning, subagents that run in isolated context windows, a pluggable filesystem, shell access, persistent memory, and human approval of tool calls for long-horizon tasks.

DSPy
dspy.ai
DSPy is an open-source Python framework for programming language models with declarative modules and signatures instead of hand-written prompts, with optimizers that tune prompts and weights against a metric for agents, RAG pipelines, and classifiers.

Eino
ByteDance · cloudwego.io
Eino is an open-source Go framework for LLM applications from ByteDance's CloudWeGo project, with reusable components, an Agent Development Kit for tool use, multi-agent coordination, and human-in-the-loop interrupts, and graph composition that follows Go conventions.
Genkit
Google · genkit.dev
Genkit is Google's open-source framework for building AI-powered apps and agents in TypeScript, Go, Python, and Dart, with one interface to models from Gemini, Claude, OpenAI, and other providers; it began as Firebase Genkit.
Google Agent Development Kit (ADK)
Google · adk.dev
Google's Agent Development Kit is an open-source, code-first framework for building, evaluating, and deploying agents in Python, TypeScript, Go, Java, and Kotlin, with built-in Gemini access and adapters for other model providers.
Haystack
deepset · haystack.deepset.ai
Haystack is deepset's open-source Python framework for building agents and RAG systems from modular components connected in pipelines, with integrations for model providers and document stores and a commercial Haystack Enterprise Platform for deployment.

Koog
JetBrains · jetbrains.com
Koog is JetBrains' open-source Kotlin framework for building AI agents that run on the JVM, Android, iOS, JavaScript, and WebAssembly, aimed at teams that want agents written in idiomatic Kotlin across platforms.
LangChain
langchain.com
LangChain is an open-source framework for building agents from prebuilt agent architectures and a large library of integrations with model providers, vector stores, retrievers, and tools, with LangGraph underneath for lower-level orchestration.
LangChain4j
docs.langchain4j.dev
LangChain4j is an open-source Java library for building LLM applications and agents on the JVM, with unified APIs across model providers and embedding stores plus components for tool calling, chat memory, agents, and retrieval-augmented generation.
LangGraph
LangChain · langchain.com
LangGraph is an open-source, low-level orchestration framework from LangChain for building stateful agents as graphs, with durable execution, persistence, streaming, and human-in-the-loop checkpoints, in Python and TypeScript.

Letta
letta.com
Letta, formerly MemGPT, builds stateful agents with long-term memory; its open-source Letta Code agent lets agents rewrite their own memory, skills, and prompts, and runs through a CLI, a self-hosted server, Letta Cloud, or the Letta Agent SDK.

LlamaIndex
llamaindex.ai · San Francisco, United States · founded 2023
LlamaIndex is an open-source Python framework for agents and multi-step workflows over private data, with connectors, indexing, and retrieval components; the company now focuses mainly on LlamaParse, and its TypeScript port is deprecated.

Mastra
Kepler Software · mastra.ai
Mastra is an open-source TypeScript framework for agents, graph-based workflows, memory, RAG, evals, and observability, with human-in-the-loop suspend and resume and a local Studio for testing; enterprise directories use a separate license.

Microsoft Agent Framework
Microsoft · learn.microsoft.com
Microsoft Agent Framework is an open-source SDK for Python and .NET, generally available since April 2026, that succeeds Semantic Kernel and the archived AutoGen for building agents and multi-agent workflows, with support for MCP and A2A.

OpenAI Agents SDK
OpenAI · openai.github.io
The OpenAI Agents SDK is a lightweight open-source framework for Python and TypeScript built on agents, handoffs between agents, guardrails, sessions, and built-in tracing, and it also works with models from other providers.

Pydantic AI
Pydantic · pydantic.dev
Pydantic AI is an open-source Python agent framework from the Pydantic team with a typed agent loop, validated structured outputs and tool arguments, model fallbacks across many providers, and durable execution through integrations such as Temporal.
Rig
rig.rs
Rig is an open-source Rust library for building LLM applications and agents, with one API across many model providers, type-safe tools, structured output, and integrations with vector stores for retrieval.

Semantic Kernel
Microsoft · learn.microsoft.com
Semantic Kernel is Microsoft's open-source, model-agnostic SDK for building agents and multi-agent systems in Python, .NET, and Java, with plugins, vector store connectors, and MCP support; Microsoft now directs new projects to Microsoft Agent Framework.
Microsoft names Microsoft Agent Framework as the successor and continues to fix critical bugs and security issues in Semantic Kernel v1.x.
smolagents
Hugging Face · huggingface.co
smolagents is Hugging Face's open-source Python library for running agents in a few lines of code, with deliberately minimal abstractions and a focus on code agents that write their actions as Python, plus support for models from many providers.
Spring AI
Broadcom · spring.io
Spring AI is the Spring project's open-source framework for adding AI to Java applications, with a ChatClient API, advisors, tool calling, structured output, chat memory, and MCP client and server starters that follow Spring Boot conventions.
Strands Agents
Amazon Web Services · strandsagents.com
Strands Agents is an open-source SDK from AWS for building agents in Python and TypeScript that run in-process without a hosted control plane, with model portability across Bedrock, Anthropic, OpenAI, and Gemini, MCP, multi-agent patterns, and a prebuilt agent loop.
Vercel AI SDK
Vercel · ai-sdk.dev
The AI SDK from Vercel is an open-source TypeScript toolkit for AI applications and agents, with one interface across model providers, streaming, fallbacks, structured output, a ToolLoopAgent class for tool-calling loops, and chat interface support.
VoltAgent
voltagent.dev
VoltAgent is an open-source TypeScript agent framework with typed tools, memory adapters, a workflow engine, supervisor and sub-agent coordination, MCP support, and resumable streaming, paired with the VoltOps console for observability, evals, and deployment.
How to choose
- 01Abstraction level
- Low-level graph or workflow primitives give control over every step, while higher-level agent classes and prebuilt agents get a prototype running faster.
- 02Language support
- Python, TypeScript, .NET, Java, Kotlin, Go, or Rust support should match the team's production stack.
- 03Model support
- Provider-agnostic frameworks let you switch models or mix providers without rewriting agent code.
- 04State and durability
- Checkpointing, persistence, and human-in-the-loop pauses matter for long-running or approval-gated tasks.
- 05Multi-agent and protocols
- Handoffs, supervisor patterns, and support for MCP and the A2A protocol determine how agents and tools connect.
- 06Observability and deployment
- Built-in tracing, OpenTelemetry export, and a clear path to production hosting reduce operational work.
Frequently asked questions
What is an AI agent framework?
- An AI agent framework is a software library for building applications in which a language model's output drives a sequence of tool calls to complete a task. It handles the model and tool loop, conversation state, memory, error handling, and multi-agent coordination, so developers write tools and instructions rather than orchestration code. LangGraph, CrewAI, and the OpenAI Agents SDK are examples.
LangGraph vs CrewAI: what is the difference?
- LangGraph is a low-level framework that models an agent as a graph of nodes and edges with explicit shared state, checkpoints, and human-in-the-loop interrupts, which gives fine control over each step. CrewAI organizes work around Crews of role-based agents that collaborate on tasks, plus Flows for event-driven control. Both are MIT-licensed; CrewAI is Python-only, while LangGraph also has a TypeScript version.
Which AI agent framework does Microsoft recommend?
- Microsoft recommends Microsoft Agent Framework, an open-source SDK for Python and .NET that reached general availability in April 2026. It succeeds AutoGen, whose repository is now marked archived and no longer maintained, and Semantic Kernel, which still receives critical bug and security fixes while most new features go to Agent Framework. Microsoft publishes migration guides from both projects.
Which AI agent framework is best for production?
- No single framework is best for every production system. Teams usually decide on language first, then on how much control they need: graph frameworks such as LangGraph suit long-running, approval-gated workflows, while smaller loops such as Pydantic AI or the OpenAI Agents SDK suit focused tools. Check durability, tracing, and model portability, and build the same small task in two candidates before standardizing.
Related guides
AI agents hubOther categories
- Model providers
- Inference providers
- GPU clouds
- Serving engines
- Vector databases
- Embedding and reranking models
- Document parsing and data ingestion
- Fine-tuning and post-training
- Agent infrastructure
- Web search APIs
- MCP platforms
- Voice AI
- AI gateways
- LLM observability and evaluation
- Guardrails and AI security
- AI coding tools
Product details change quickly; check each vendor’s site for current features, licensing and pricing.