ScriptsApr 6, 2026·2 min read

AgentOps — Observability Dashboard for AI Agents

Python SDK for monitoring AI agent sessions with real-time dashboards, token tracking, cost analysis, and error replay. Two lines of code to instrument any framework. 4,500+ GitHub stars.

AG
Agent Toolkit · Community
Quick Use

Use it first, then decide how deep to go

This block should tell both the user and the agent what to copy, install, and apply first.

  1. Install: pip install agentops
  2. Add 2 lines to your agent code:
import agentops
agentops.init("YOUR_API_KEY")  # Get free key at agentops.ai

# Your existing agent code works unchanged
# AgentOps auto-instruments OpenAI, Anthropic, LangChain, CrewAI, etc.
  1. View sessions at app.agentops.ai
Intro

AgentOps is a Python observability SDK that gives you real-time dashboards, session replays, and cost tracking for AI agent applications with 4,500+ GitHub stars. Add two lines of code and get full visibility into every LLM call, tool use, and error your agents produce — across OpenAI, Anthropic, LangChain, CrewAI, AutoGen, and more. Best for teams running AI agents in production who need to debug failures and track costs. Works with: any Python AI framework. Setup time: under 1 minute.

Core Features

Auto-Instrumentation

AgentOps automatically detects and instruments popular frameworks:

import agentops
agentops.init()

# These are automatically tracked:
from openai import OpenAI
from anthropic import Anthropic
from crewai import Agent, Task, Crew

Supported: OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI, AutoGen, Cohere, Mistral, Groq, and more.

Session Replay

Every agent run is recorded. View the complete timeline of LLM calls, tool invocations, errors, and custom events.

Cost Tracking

Real-time token usage and cost breakdown by model, session, and user:

agentops.init(tags=["production", "customer-support"])

Error Analysis

Replay the exact sequence of events that led to any failure. Filter by error type, model, or time range.

Custom Events

agentops.record(agentops.ActionEvent(
    action_type="web_search",
    params={"query": "latest AI news"},
    returns="10 results found"
))

Key Stats

  • 4,500+ GitHub stars
  • 15+ auto-instrumented frameworks
  • Free tier: 1,000 sessions/month
  • Real-time dashboard with <1s latency
  • SOC 2 compliant

FAQ

Q: What is AgentOps? A: AgentOps is a Python observability SDK that provides real-time dashboards, session replays, and cost tracking for AI agent applications with just two lines of code.

Q: Is AgentOps free? A: Yes, the SDK is open-source under MIT license. Free tier includes 1,000 sessions/month.

Q: Does AgentOps work with Claude? A: Yes, AgentOps auto-instruments the Anthropic Python SDK. Every Claude API call is automatically tracked.

🙏

Source & Thanks

Created by AgentOps-AI. Licensed under MIT.

agentops — ⭐ 4,500+

Thanks to the AgentOps team for bringing production observability to AI agents.

Discussion

Sign in to join the discussion.
No comments yet. Be the first to share your thoughts.

Related Assets

Optio — Workflow Orchestrator for AI Coding Agents

Automates the full AI development lifecycle from task planning to merged PR. Orchestrates AI agents through planning, execution, code review, and merge. 800+ GitHub stars.

Agent Toolkit
◈Home🔍Search👤Me