Compare top LLM gateway and proxy tools for routing AI requests. Covers LiteLLM, Bifrost, Portkey, and OpenRouter for cost optimization, failover, and multi-provider access.
这里应该同时让用户和 Agent 知道第一步该复制什么、安装什么、落到哪里。
LLM 网关代理 AI 请求，提供统一 API、故障转移和成本控制。
LLM 网关是应用和 LLM 供应商之间的代理，统一 API + 故障转移 + 缓存 + 成本追踪。
一句话总结：LLM 请求代理对比，LiteLLM（开源 200+ 模型）、Bifrost（最快 <100us）、Portkey（企业级）、OpenRouter（按用量付费）。
模型路由（简单→便宜，复杂→高端）+ 缓存 + 降级链 + 预算限制。
Q: 需要网关吗？ A: 生产环境需要，原型阶段直接调用 API。
LiteLLM | Bifrost | Portkey | OpenRouter
Official Anthropic SDK for building AI agents with tool use, memory, and orchestration. Production-grade agent framework with Claude as the backbone for autonomous tasks.
Build multi-agent systems where AI agents collaborate through role-playing. CAMEL enables autonomous cooperation between agents with structured communication protocols.
Python-based multi-agent orchestration built on Claude Agent SDK. Opus decomposes tasks, Haiku workers execute in parallel waves with real-time TUI dashboard and budget control.