Portkey AI Gateway routes to 250+ LLMs with sub-1ms latency, 40+ guardrails, retries, fallbacks, and caching. 11.1K+ stars. Apache 2.0.
This block should tell both the user and the agent what to copy, install, and apply first.
# Run locally
npx @portkey-ai/gateway
# API at http://localhost:8787/v1
# Console at http://localhost:8787/public/
# Or use Python SDK
pip install portkey-aiPortkey AI Gateway is a blazing fast gateway with integrated guardrails that routes to 250+ language, vision, audio, and image models across 45+ providers. With 11,100+ GitHub stars and Apache 2.0 license, it delivers sub-1ms latency with a 122KB footprint. Features automatic retries, fallbacks, load balancing, 40+ pre-built guardrails, smart caching, multi-modal support, agent framework integrations, and enterprise compliance (SOC2, HIPAA, GDPR).
Best for: Teams needing a unified API gateway across multiple LLM providers Works with: Claude Code, OpenAI Codex, Cursor, Gemini CLI, Windsurf
Q: What is Portkey AI Gateway? A: LLM gateway with 11.1K+ stars routing to 250+ models. Sub-1ms latency, guardrails, caching, enterprise compliance. Apache 2.0.
Q: How do I install it? A: npx @portkey-ai/gateway. Or pip install portkey-ai for Python SDK.
Portkey-AI/gateway — 11,100+ GitHub stars
Void is an open-source AI code editor alternative to Cursor. 28.5K+ stars. Checkpoints, custom models, local hosting, built on VS Code. Apache 2.0.
AI Shell converts natural language into shell commands using AI. 5.2K+ stars. 13+ languages, chat mode, custom endpoints. MIT. By Builder.io.
LLM is a CLI and Python library for accessing 100+ LLMs via APIs or locally. 11.5K+ stars. SQLite logging, embeddings, structured data. Apache 2.0.