Key Features
- 250+ models across 45+ providers
- Sub-1ms latency, 122KB footprint
- Retries, fallbacks, load balancing
- 40+ input/output guardrails
- Smart caching (simple + semantic)
- SOC2, HIPAA, GDPR compliance
FAQ
Q: What is Portkey AI Gateway? A: LLM gateway with 11.1K+ stars routing to 250+ models. Sub-1ms latency, guardrails, caching, enterprise compliance. Apache 2.0.
Q: How do I install it? A: npx @portkey-ai/gateway. Or pip install portkey-ai for Python SDK.