Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 3 of 41

9router-go★ 303

High-performance Go proxy gateway for 9Router LLM routing — 32K RPS, 42MB RAM, CGO-free

underclass★ 303

underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.

1flowbase★ 296

Build for agents — from the AI Gateway to the entire application stack.

reverse-engineered-chatgpt★ 295

Unofficial reverse-engineered ChatGPT API in Python

cc-router★ 295

本地运行的大模型聚合网关,GUI桌面端app,零代码部署,把Coding Plan、大模型 API 额度聚合成一个虚拟 Plan,一键接入 Claude Code、Claude Desktop App、OpenClaw、OpenCode 等工具。Bundle your scattered Token Plan, Coding Plan, and LLM API quotas into a single virtual Plan, and plug it into Claude Code, Claude Desktop App, OpenClaw, OpenCode, and more.

openaigo★ 294

OpenAI GPT3/3.5 and GPT4 ChatGPT API Client Library for Go, simple, less dependencies, and well-tested

openai-streams★ 292

Tools for working with OpenAI streams in Node.js and TypeScript.

Thor★ 283

Thor is a powerful artificial intelligence model management tool, whose main purpose is to achieve unified management and use of multiple AI models. Through Thor, users can easily manage and utilize numerous AI models

ccproxy-api★ 279

is a local reverse proxy providing unified access to multiple AI providers (Claude, Codex) through a single interface, using your existing subscriptions without API key billing.

IntelliNode★ 276

Access the latest AI models like ChatGPT, Fable, Deepseek, Diffusion, Hugging face, and beyond through a unified prompt layer and performance evaluation

llmtrim★ 276

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).

raycast-ai-openrouter-proxy★ 271

Integrate any OpenAI-compatible API with Raycast AI

FreeGPT★ 271

Use GPT 3.5 / 4 Free - No API Key Need

llm-pricing★ 271

docker region:us

shunt★ 267

Shunt Claude Code agents to any model — selective, per-agent inference-layer routing proxy

liter-llm★ 266

One API for every LLM: 170+ providers through one client, with a Rust core and native bindings for every major language.

IntentRoute-AI★ 260

Open-source AI-assisted per-application routing for Windows with OpenAI/Ollama drafts and a sing-box TUN data plane.

openai-scala-client★ 258

Scala client for OpenAI API and other major LLM providers

fastapi-admin★ 256

企业级 LLM API 快速集成系统,支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等,简洁的页面风格,轻量高效且稳定,支持Docker一键部署。

omniai★ 254

OmniAI standardizes the APIs for multiple AI providers like OpenAI's Chat GPT, Mistral's LeChat, Claude's Anthropic, Google's Gemini and DeepSeek's Chat..

claude-code-nexus★ 251

Claude API Proxy platform - Seamlessly forward Claude Code requests to any OpenAI-compatible API service with smart model mapping, streaming support, deployed on Cloudflare Worker.

google-bard-api★ 249

This project provides a FastAPI wrapper for interacting with Google Bard, a conversational AI by Google. It allows users to send messages to Google Bard and receive responses through a simple API.

ms-copilot-play★ 245

Cloudflare Worker 的 Microsoft Copilot 加速服务。Microsoft Copilot 是基于 OpenAI GPT-4 的强大 AI 并且能够使用 Bing 搜索来解答问题。简单部署即可在国内高速访问原滋原味的 Microsoft Copilot 的几乎全部功能,聊天,笔记本,插件,图像生成,分享等等..

codex-pooler★ 244

The full featured self-hosted Codex gateway, for teams, agents and you

claudecode-vertex-proxy★ 242

Proxy service for Claude Code to access Claude models via GCP Vertex AI | 让 Claude Code 通过 GCP Vertex AI 访问 Claude 模型

bella-openapi★ 241

Bella OpenAPI是一个提供了丰富的AI调用能力的API网关,可类比openrouter,与之不同的是除了提供聊天补全(chat-completion)能力外,还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力,同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

ungate★ 241

Use your Claude and ChatGPT subscriptions in Cursor instead of paying for API tokens.

claude-code-gpt-5-codex★ 240

Run Anthropic's Claude Code CLI with OpenAI models such as GPT-5-Codex, GPT-5.1, and others via a local LiteLLM proxy.

openai-auto-register★ 240

OpenAI Codex Auto Register & Token Fetcher | OpenAI Codex 自动注册与 Token 提取

bitrouter★ 239

elastic inference for your agentic workloads

open-responses★ 238

Self-hosted alternative to OpenAI's Responses API compatible with Agents SDK and works with all model providers (Claude/R1/Qwen/Ollama etc)

deeperseeker★ 231

Use your own DeepSeek web account through OpenAI & Anthropic-compatible APIs. FastAPI reverse proxy with tool calling, vision & streaming.

aisix★ 229

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

busbar★ 226

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

esperanto★ 223

A unified interface for various AI model providers

api-key-tester★ 222

API Key 测活工具 - 用于批量检测 OpenAI、Claude、Gemini 等 API 密钥有效性 | Modern API Key Tester - Used for batch testing the validity of API keys such as OpenAI, Claude, Gemini

qwengate★ 220

Drop-in OpenAI-compatible API gateway for Qwen AI models. Use your Qwen account (chat.qwen.ai) as a free AI API provider in any OpenAI-compatible client — Cursor, Continue.dev, Claude Code, VS Code Copilot, or any coding agent. Self-hosted, Chromium-based auth, streaming support, tool calling, dashboard.

openai_ex★ 218

Community maintained Elixir library for OpenAI API

llm.ts★ 212

Call any LLM with a single API. Zero dependencies.

agent-maestro★ 211

Turn VS Code into your compliant AI playground! With Agent Maestro, spin up Cline or Roo on demand and plug Claude Code or Codex straight in through an OpenAI/Anthropic-compatible API.

proxy★ 211

Local-first LLM proxy that meters what every agent run costs and kills runaways before they drain your budget. Free, MIT.

opencode-copilot-chat★ 211

Use 30+ AI models (DeepSeek, Kimi, GLM, Claude, GPT-5.5, Gemini, Grok) in GitHub Copilot Chat - free via BYOK. No Copilot Pro needed.

inference-gateway★ 210

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

antigravity-add-model★ 209

Proxy patch for Google Antigravity that intercepts internal Cloud Code API and adds support for OpenAI, Claude, Ollama, Gemini and any custom LLM provider.

astra-assistants-api★ 205

Drop in replacement for the OpenAI Assistants API

unofficial-claude-api★ 205

Unofficial Claude API supporting direct HTTP chat creation/deletion/retrieval, messages with multiple file attachments and auto session gathering using Firefox with geckodriver.

liaison★ 204

Self-hosted access to private apps, LLMs, and AI agents — browser workspaces, scoped API sharing, and context-aware AI assistance.

ccg-gateway★ 203

多Agent兼容LLM智能网关与效率工具

OmniCopilot★ 200

1200+ AI models in your GitHub Copilot Chat — free & forever free. VS Code extension powered by OmniRoute: 340+ providers (90+ free) — Kimi, Claude, GPT, Gemini, GLM, DeepSeek, Qwen — with agent mode, tool calling, vision and quota-aware auto-fallback. MIT.

claude2api★ 199

Claude2API 是基于 Go + Docker 构建的 Claude.ai API 兼容网关、账号池与网页镜像服务,支持 OpenAI Chat Completions、Responses 和 Anthropic Messages 接口,可接 入 Claude Code、Codex CLI 等客户端,并提供账号轮询、流式输出、多轮对话、多模态图片、Thinking、Function Calling、Tool Use、API Key 鉴权、调用日志和后台管理。

openai_pipe★ 197

A UNIX-ey interface to OpenAI

liter-llm★ 196

Universal LLM API client — 142+ providers, 11 native language bindings, powered by Rust core

openai-fetch★ 196

Minimal and opinionated OpenAI client powered by fetch.

Trae-Proxy★ 196

An intelligent API proxy tool designed to intercept and redirect OpenAI API requests.一个智能的API代理工具,专门用于拦截和重定向OpenAI API请求到自定义后端服务。支持多后端配置、动态模型映射和流式响应处理。

AIRouter★ 192

🚀 AIRouter - 智能AI路由器:为多个LLM提供商提供统一API接口,支持负载均衡、故障转移和智能路由 | Intelligent AI Router with unified API interface, load balancing, and smart routing for multiple LLM providers

vercel-llm-api★ 189

A reverse engineered Python API wrapper for the Vercel AI Playground, which provides free access to many large language models without needing an account.

qwenproxy★ 188

Proxy API OpenAI-compatible que usa automação com Playwright para rotear requisições para modelos do Qwen com suporte a múltiplas contas, tools e sessões persistentes.

OpenAI★ 186

A Swift client for the OpenAI API.

Misceo★ 185

Local Anthropic-compatible AI gateway with cheap-first routing, quality gates, safe model handoffs, and an embedded cost dashboard.

gpt4-openai-api★ 184

Python package that provides (unofficial) API access to the GPT-4 through chat.openai.com. Works with langchain. Supports search DALL-E 3, plugins, continuing generation.

open-responses-server★ 184

Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm compliant.

m365-copilot-proxy★ 183

OpenAI-compatible proxy for Microsoft 365 Copilot — use the Copilot licence you already have as a backend for pi, openclaw and other coding agents. Prompt-emulated tool calling, no extra licence, no MCP.

museai★ 181

High-performance OpenAI-compatible API gateway and bridge for muse.ai personal AI agents, ready for 9Router multi-model integration.

RelayFreeLLM★ 178

A restful API designed to route user prompts to various AI model providers.

OmniGlyph★ 178

Cut your Claude bill 59–70% by rendering bulky LLM context as dense PNG pages — 100% read accuracy, exact per-provider billing math (Anthropic/OpenAI/Gemini), fail-closed gates, measured benchmarks. CLI + proxy + Cloudflare Workers. Docs in 42 languages. Part of the OmniRoute family.

autocache★ 177

🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required

antiglaude★ 176

Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API

routeVSCODE★ 172

⚡ Zero-reload dynamic AI model switcher & local proxy for VSCode Copilot Chat via 9Router

llm-api★ 170

Run any Large Language Model behind a unified API

chatrapper★ 169

网页版 ChatGPT 包装成 API

openai★ 168

An R package-wrapper around OpenAI API

neurolink★ 167

The pipe layer of an AI nervous system — one interface connecting provider neurons to your application, across three inference types: generate, stream, and a calibrated decide (via TypeSafe Jev). MCP-native, voice (TTS/STT/realtime), RAG, memory, file processors. Powers Tara, Yama and Clairvoyance a

chatgpt-specimen-toolbox★ 167

ChatGPT Session ↔ 9 种主流认证格式 N×N 双向互转(auth.json / Cockpit / CPA / Sub2API / 9router / AxonHub / Codex-Manager / Codex Auth / Raw)· 11 种来源自动识别 · Plus 多区域 / Team 工作区订阅长链一站生成(v2.4.0 Stripe init 三步法长链引擎,拿 pay.openai.com 可靠长链)· 油猴 UserScript + Chrome/Edge/Firefox MV3 扩展双发布 · 全程本地处理零上报 · Specimen 设计语言

keirouter★ 167

Your friendly, blazing-fast, self-hostable AI gateway

freebuff-proxy★ 167

OpenAI-compatible gateway for FreeBuff coding models. Token pool, session lifecycle, TLS stealth, embedded admin dashboard. No ads, no CLI, just /v1/chat/completions.

chatgpt-route-inspector★ 167

ChatGPT 模型路由检测器:查看服务器报告的真实响应模型,自动识别路由降级,GPT Pro 计划降智查询。|ChatGPT Model Route Inspector: view the actual response model reported by the server, automatically detect routing downgrades, and check whether GPT Pro requests are being downgraded.

opencode2api★ 162

OpenCode zen/go to OpenAI Codex/Anthropic Claude Code API proxy

cnllm★ 161

Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.

lm-proxy★ 161

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

amazing-openai-api★ 160

Convert different model APIs into the OpenAI API format out of the box.

grokbuild-proxy★ 159

本地自托管的 Grok Build → Claude Code / OpenAI 兼容代理 | Local self-hosted Grok Build compatibility proxy

awesome-ai-gateway★ 157

⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

llm-api-proxy★ 153

Provides the same proxy OpenAI API interface for different LLM models, and supports deployment to any Edge Runtime environment.

PicoAIProxy★ 153

Reverse proxy for OpenAI and Anthropic written in server-side Swift

x402-openai-typescript★ 153

Drop-in OpenAI Typescript client with transparent x402 payment support.

Z.ai2api★ 153

将 Z.ai Chat 代理为 OpenAI/Anthropic Compatible 格式,支持多模型列表映射、免令牌、智能处理思考链、图片上传等功能;Z.ai ZtoApi z2api ZaitoApi zai X-Signature 签名 GLM 4.5 v 4.6

litellmjs★ 152

JavaScript implementation of LiteLLM.

KiroaaS★ 152

KiroaaS (Kiro as a Service) Your Gateway to Kiro. Expose Kiro's models to any application via standard APIs. Power your tools with Kiro's intelligence.

freellmpool★ 152

Free LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.

openclaw-claude-bridge★ 151

HTTP bridge powering OpenClaw's AI agents via Claude Code CLI — manages persistent sessions, auto-resume, extended thinking, and provides a real-time React dashboard with per-agent cost tracking. Exposes an OpenAI-compatible API.

duckai★ 151

duck.ai openai compatible api server

openai4j★ 148

Java client library for OpenAI API

chat-relay★ 148

Chat Relay is a system that allows Cline/RooCode to communicate with web-based AI chat interfaces (like Gemini, AI Studio, ChatGPT, and Claude) through an OpenAI-compatible API. This enables using models that may not have public APIs through their web interfaces.

llm.js★ 148

Universal LLM Interface

voidllm★ 148

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

openai-deno-build★ 146

Deno build of the official Typescript library for the OpenAI API.

hermes-tool-router★ 146

Deterministic, fail-open tool routing for Hermes Agent with an optional local-model fallback.

edgee★ 144

Official Edgee CLI to interract with Edgee's Agent Gateway. Route Claude Code, Codex, Cursor, VS Code + Copilot, and more through Edgee's hosted gateway to cut token spend.

dsh-ntr★ 144

让你的Deepseek harness成为一个统一的agent入口,轻松接入codebuddy、claude code、opencode、qoder | Make your Deepseek harness a unified agent gateway for easy integration with CodeBuddy, Claude Code, OpenCode, Qoder, and more.

ocp★ 143

Turn your Claude Pro/Max subscription into an OpenAI-compatible API for your IDEs and devices — LAN auth, per-key quotas, response cache, disciplined cli.js alignment. $0 extra cost.

More in Agent frameworks & infrastructure