# Latitude — AI Agent Engineering Platform

> Open-source platform for building, evaluating, and monitoring AI agents in production. Observability, prompt playground, LLM-as-judge evals, experiment comparison. LGPL-3.0, 4,000+ stars.

## Install

Save the content below to `.claude/skills/` or append to your `CLAUDE.md`:

## Quick Use

1. Try Latitude Cloud at [latitude.so](https://latitude.so)

2. Or self-host with Docker:
```bash
git clone https://github.com/latitude-dev/latitude-llm.git
cd latitude-llm
docker compose up -d
```

3. Connect your AI application and start monitoring prompts, responses, and performance.

---

## Intro

Latitude is an open-source AI agent engineering platform with 4,000+ GitHub stars. It provides full observability for LLM applications — capturing prompts, inputs/outputs, tool calls, and performance metrics. Features a prompt playground for iteration, dataset curation for testing, LLM-as-judge evaluations, experiment comparison across models, and automated evaluation guards. Best for teams building production AI applications who need visibility into how their agents perform and tools to improve them.

Explore more AI development tools on [TokRepo AI Open Source](https://tokrepo.com/en/@AI%20Open%20Source).

---

## Latitude — Build, Evaluate, Monitor AI Agents

### The Problem

Building AI agents is easy. Making them work reliably in production is hard. You need to see what prompts are sent, what responses come back, how tool calls behave, and whether quality is improving or degrading over time.

### The Solution

Latitude gives you full visibility into your AI pipeline with tools to evaluate and improve agent performance.

### Key Features

| Feature | Description |
|---------|------------|
| **Observability** | Capture prompts, I/O, tool calls, latency, costs |
| **Prompt Playground** | Iterate on prompts with instant feedback |
| **Datasets** | Curate test data for consistent evaluation |
| **Evaluations** | LLM-as-judge, custom metrics, automated grading |
| **Experiments** | Compare performance across models and providers |
| **Annotations** | Label and cluster issues in agent responses |
| **Guards** | Automated evaluation checks before responses ship |

### Integration

```typescript
import { Latitude } from "@latitude-data/sdk";

const latitude = new Latitude("your-api-key");

// Log a prompt-response pair
await latitude.log({
  prompt: "Summarize this document...",
  response: "The document discusses...",
  model: "claude-sonnet-4-20250514",
  duration_ms: 1200,
  tokens: { input: 500, output: 150 }
});
```

### Evaluation Example

```typescript
// Run LLM-as-judge evaluation
const result = await latitude.evaluate({
  input: userQuery,
  output: agentResponse,
  criteria: [
    "relevance",
    "accuracy",
    "helpfulness"
  ],
  judge_model: "gpt-4o"
});
```

### FAQ

**Q: What is Latitude?**
A: An open-source platform for building, evaluating, and monitoring AI agents in production. It provides observability, prompt management, LLM evaluations, and experiment comparison.

**Q: Is Latitude free?**
A: The self-hosted version is free under LGPL-3.0. Latitude Cloud has a free tier for smaller projects.

**Q: How is Latitude different from LangFuse?**
A: Latitude focuses on the full agent engineering lifecycle — from prompt iteration to evaluation to monitoring — with built-in LLM-as-judge capabilities and experiment comparison.

---

## Source & Thanks

> Created by [Latitude](https://github.com/latitude-dev). Licensed under LGPL-3.0.
>
> [latitude-llm](https://github.com/latitude-dev/latitude-llm) — ⭐ 4,000+

Thanks to the Latitude team for making AI agent engineering more transparent and reliable.

---

<!-- ZH -->

## Quick Use

1. Try the cloud version at [latitude.so](https://latitude.so)

2. Or self-host with Docker:
```bash
git clone https://github.com/latitude-dev/latitude-llm.git
cd latitude-llm && docker compose up -d
```

3. Connect your AI app and start monitoring prompts, responses, and performance.

---

## Introduction

Latitude is an open-source AI agent engineering platform with 4,000+ GitHub stars. It provides full observability for LLM applications — capturing prompts, inputs/outputs, tool calls, and performance metrics. Supports a Prompt Playground, dataset curation, LLM-as-judge evaluation, cross-model experiments, and automated evaluation guards. Ideal for teams building production-grade AI apps.

---

## Latitude — Build, Evaluate, and Monitor AI Agents

### Core Features

- **Observability** — capture prompts, I/O, tool calls, latency, cost
- **Prompt Playground** — iterate prompts with instant feedback
- **Datasets** — curate test data
- **Evaluation** — LLM-as-judge and custom metrics
- **Experiments** — compare performance across models
- **Auto-guards** — automatic checks before responses go out

### FAQ

**Q: What is Latitude?**
A: An open-source AI agent engineering platform providing observability, evaluation, and monitoring.

**Q: How does it differ from LangFuse?**
A: Latitude covers the full agent engineering lifecycle with built-in LLM-as-judge and experiment comparisons.

---

## Source & Thanks

> Created by [Latitude](https://github.com/latitude-dev). Licensed under LGPL-3.0.
>
> [latitude-llm](https://github.com/latitude-dev/latitude-llm) — ⭐ 4,000+

---
Source: https://tokrepo.com/en/workflows/latitude-ai-agent-engineering-platform-f0b521ab
Author: AI Open Source