# Promptfoo — Test & Red-Team LLM Apps

> Promptfoo is a CLI for evaluating prompts, comparing models, and red-teaming AI apps. 18.9K+ GitHub stars. Side-by-side comparison, vulnerability scanning, CI/CD. MIT.

## Install

Save as a script file and run:

## Quick Use

```bash
# Install
npm install -g promptfoo
# or: brew install promptfoo / pip install promptfoo

# Initialize evaluation config
promptfoo init

# Run evaluation
promptfoo eval

# View results in browser
promptfoo view

# Red-team scan for vulnerabilities
promptfoo redteam init
promptfoo redteam run
```

---

## Intro

Promptfoo is a CLI and library for evaluating and red-teaming LLM applications. With 18,900+ GitHub stars and MIT license, it enables testing prompts across multiple LLM providers, side-by-side model comparison (OpenAI, Claude, Gemini, Llama), automated red teaming and vulnerability scanning, CI/CD integration for continuous testing, and privacy-first local execution where prompts never leave your machine. Results are viewable in a web-based UI or command line.

**Best for**: Teams shipping AI products who need systematic prompt testing and security scanning
**Works with**: Claude Code, OpenAI Codex, Cursor, Gemini CLI, Windsurf
**Providers**: OpenAI, Claude, Gemini, Llama, Mistral, and 50+ more

---

## Key Features

- **Prompt evaluation**: Test prompts against assertions and expected outputs
- **Model comparison**: Side-by-side across 50+ LLM providers
- **Red teaming**: Automated vulnerability scanning for AI apps
- **CI/CD integration**: Run evaluations in your deployment pipeline
- **Privacy-first**: All prompts stay on your machine
- **Web UI**: Visual results viewer and comparison dashboard
- **Code scanning**: Detect prompt injection and security issues

---

### FAQ

**Q: What is Promptfoo?**
A: Promptfoo is an LLM evaluation and red-teaming CLI with 18.9K+ stars. Test prompts, compare models, scan for vulnerabilities. Local execution, CI/CD ready. MIT.

**Q: How do I install Promptfoo?**
A: `npm install -g promptfoo` or `brew install promptfoo`. Then `promptfoo init` and `promptfoo eval`.

---

## Source & Thanks

> Created by [Promptfoo](https://github.com/promptfoo). Licensed under MIT.
> [promptfoo/promptfoo](https://github.com/promptfoo/promptfoo) — 18,900+ GitHub stars

---
Source: https://tokrepo.com/en/workflows/42c43368-a482-4fad-b23d-d80e0530377b
Author: Script Depot