Cette page est affichée en anglais. Une traduction française est en cours.
ConfigsApr 1, 2026·1 min de lecture

Portkey AI Gateway — Route to 250+ LLMs

Portkey AI Gateway routes to 250+ LLMs with sub-1ms latency, 40+ guardrails, retries, fallbacks, and caching. 11.1K+ stars. Apache 2.0.

AI Open Source
AI Open Source · Community
Introduction

Portkey AI Gateway is a blazing fast gateway with integrated guardrails that routes to 250+ language, vision, audio, and image models across 45+ providers. With 11,100+ GitHub stars and Apache 2.0 license, it delivers sub-1ms latency with a 122KB footprint. Features automatic retries, fallbacks, load balancing, 40+ pre-built guardrails, smart caching, multi-modal support, agent framework integrations, and enterprise compliance (SOC2, HIPAA, GDPR).

Best for: Teams needing a unified API gateway across multiple LLM providers Works with: Claude Code, OpenAI Codex, Cursor, Gemini CLI, Windsurf

Key Features

  • 250+ models across 45+ providers
  • Sub-1ms latency, 122KB footprint
  • Retries, fallbacks, load balancing
  • 40+ input/output guardrails
  • Smart caching (simple + semantic)
  • SOC2, HIPAA, GDPR compliance

FAQ

Q: What is Portkey AI Gateway? A: LLM gateway with 11.1K+ stars routing to 250+ models. Sub-1ms latency, guardrails, caching, enterprise compliance. Apache 2.0.

Q: How do I install it? A: npx @portkey-ai/gateway. Or pip install portkey-ai for Python SDK.

🙏

Source et remerciements

Portkey-AI/gateway — 11,100+ GitHub stars

Discussion

Connectez-vous pour rejoindre la discussion.
Aucun commentaire pour l'instant. Soyez le premier à partager votre avis.

Actifs similaires

Mathesar — Open-Source Database Interface for PostgreSQL

Mathesar is a self-hosted web application that provides a spreadsheet-like interface for PostgreSQL databases, letting non-technical users browse, query, and manage data without writing SQL.

AI Open Source

Livebook — Interactive Notebooks for Elixir

Livebook is an open-source web application for writing interactive and collaborative code notebooks in Elixir, featuring real-time collaboration, smart cells for databases and charts, and seamless integration with the BEAM ecosystem.

AI Open Source

Nango — Open-Source Platform for Product API Integrations

Nango is an open-source unified API platform that handles OAuth flows, token refresh, rate limiting, and data syncing for 250+ third-party APIs so developers can ship product integrations faster.

AI Open Source
◈Accueil🔍Rechercher👤Moi