Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 2 of 41

openai-forward★ 984

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

NyaProxy★ 981

NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.

qwen2API★ 972

A project converting the Qwen web page to an API.

qwen2API★ 970

A project converting the Qwen web page to an API.

respan-gateway★ 961

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

ztoken-pro★ 959

稳定省钱的OpenAI、Claude、Gemini等的API接口-For企业和开发者。OpenAI的api proxy,支持ChatGPT的API调用,支持Anthropic claude的官方接口形式,支持Google gemini的官方接口形式,支持:gpt-5,sora。不需要openai Key, 不需要买openai的账号,不需要美元的银行卡,通通不用的,直接调用就行,稳定好用!!ztoken pro

otari★ 955

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

free-one-api★ 953

LLM 逆向工程接口管理 | 通过标准 OpenAI API 访问 ChatGPT / gpt4free / Bard / Claude / HuggingChat / 通义千问 等 AI 的破解版 || ChatGPT reverse engineering API management | Access all reverse engineered LLM libs by standard OpenAI API format || 免费 ChatGPT Free GPT LLM API | 逆向工程 转 OpenAI API | converts all llm libs to OpenAI API

one-api-pro★ 934

oneapi-pro is an enterprise-grade AI API Gateway built on oneapi(one-api). It has undergone a full architectural redesign, adding support for subscription plans, active-active clusters, precise billing. 本项目与new-api | sub2api不同之处是oneapi-pro是面向企业AI网关的应用场景,并不适用于中转站

Claude-API★ 912

This project provides an unofficial API for Claude AI, allowing users to access and interact with Claude AI .

gemini-cli-openai★ 893

Expose Gemini CLI endpoints as OpenAI API with Cloudflare Workers

gemini★ 837

使用 Deno 免费代理 Google Gemini,国内直连,不限地区/网络环境,打开即用。

veridrop★ 774

在线检测:veridrop.app|AI API 中转站检测工具:Claude 中转站检测、OpenAI 中转站检测、Gemini 中转站检测,中转站真伪检测、长上下文验证、思维签名验证、中转站红黑榜,自托管开源。

Freebuff2API★ 762

🚀 OpenAI-compatible Freebuff proxy with dynamic free-agent tracking, token rotation, and ready-to-use Docker deployment.

GenossGPT★ 758

One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

OpenAI-DotNet★ 756

A Non-Official OpenAI RESTful API Client for DotNet

ai-proxy-rules★ 751

AI 服务分流规则聚合: 多源合并 | 按 provider 精修 | 每日自动同步. 覆盖 OpenAI / Anthropic / Gemini / Cursor / Copilot 等主流 AI 服务, 适配 Clash / Mihomo / sing-box / Surge 等主流客户端.

OpenAI-Checker★ 741

Used to check if your IP can access OpenAI services.

smg★ 734

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

orb★ 721

All your AI providers, machines, and agent harnesses in one place. Free & native

gemini-openai-proxy★ 719

A proxy for converting the OpenAI API protocol to the Google Gemini Pro protocol.

UncommonRoute★ 703

Automatic LLM router — 82% cost savings, 79.4% accuracy, 93.4% pass rate. Drop-in OpenAI proxy.

antigravity-agent★ 676

Effortlessly manage your Antigravity multi-accounts

gemini-web-to-api★ 676

✨Reverse-engineered API for Gemini web app. It can be used as a genuine API key from OpenAI, Gemini, and Claude.

NadirClaw★ 666

Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.

SwiftOpenAI★ 665

The most complete open-source Swift package for interacting with OpenAI's public API.

openai★ 664

The unofficial OpenAI SDK for Dart & Flutter. Full API coverage + OpenAI-compatible providers (Azure, DeepSeek, LM Studio, Ollama): Responses, Chat, Realtime, Videos, Batch, Fine-tuning.

casbin-gateway★ 650

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

dsh-plugin-subscriptions★ 630

Use ChatGPT (Codex), Claude, and Grok (X Premium) subscriptions as DeepSeek Harness LLM providers — OAuth login in the web UI, no API keys

azure-openai-proxy★ 629

A proxy for Azure OpenAI API that can convert an OpenAI request into an Azure OpenAI request.

gateway★ 608

The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.

com.openai.unity★ 598

A Non-Official OpenAI Rest Client for Unity (UPM)

dario★ 592

One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.

nervecenter★ 555

new-api / sub2api 中转站账号管理中心:余额、API Key、用量、倍率、模型比价 | https://nvcenter.cc

awesome-claude-api★ 539

收集和整理可靠的Claude和OpenAI中转API资源列表,帮助开发者快速找到稳定、靠谱、高性价比的大模型API服务。Collect and curate a reliable list of Claude and OpenAI relay API resources to help developers quickly find stable, dependable, and cost-effective LLM API services.

chatgpt-python★ 522

Unofficial Python SDK for OpenAI's ChatGPT

restai★ 520

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

claude-code-mux★ 519

High-performance AI routing proxy built in Rust with automatic failover, priority-based routing, and support for 15+ providers (Anthropic, OpenAI, Cerebras, Minimax, Kimi, etc.)

dsh-codex-subscription★ 518

Use your ChatGPT Plus / Pro (Codex) subscription in DeepSeek Harness (DSH): GPT-6 & Codex models, images, web search and quota via ChatGPT sign-in — no OpenAI API key. Beta: control DSH from the ChatGPT mobile app. 在 DSH 中使用 ChatGPT 订阅,并可用 ChatGPT 手机 App 远程控制。

opengrok★ 518

Run any model in Grok Bot — one-command setup, model picker UI, evidence-based provider wire maps, and an update-proof doctor. Not farming you, arming you.

-chatgpt4.0-api-key★ 516

🌥️ 云雾API | OpenAI官方中转服务 🌥️ https://yunwu.ai 🔥 官方价格0.5:1 🔥 0.5元=1$ Token 🔥 高性价比 稳定快速!🔥 | 全球直连 | 无需代理 | 企业级稳定 | gpt3.5 | gpt4 | gpt4o | gpt4o-mini | 207+模型支持

teamclaude★ 515

Multi-account proxy for Claude Code and Codex: pools Claude Max, ChatGPT/Codex, API-key and third-party backend accounts, and rotates on quota

free-ai★ 503

Free OpenAI-compatible AI API with 50+ active models, image generation, tool calling, Anthropic-style messages, and Discord key signup. No credit card.

FreeDeepseekAPI★ 500

Локальный API-прокси для DeepSeek Web Chat с поддержкой OpenAI/Anthropic API, streaming, tool calling, Responses API и Open WebUI

CSSwitch★ 493

帮你的 Claude Science 一键接入你自己的 API:DeepSeek / 通义千问 / 智谱 GLM / Kimi / MiniMax / 小米 MiMo / 硅基流动 / OpenRouter / 任意 OpenAI·Anthropic 兼容端点

openai-api-rs★ 485

OpenAI API client library for Rust (unofficial)

HiRoute★ 481

Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.

AstrLink★ 454

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

poe-openai-proxy★ 453

A wrapper that lets you use the reverse-engineered Python library poe-api library as if it was the OpenAI API for ChatGPT. You can connect your favorite OpenAI API based apps to this proxy and enjoy the ChatGPT API for free!

GPTRouter★ 453

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

grok★ 452

使用 Deno 免费代理马斯克 Grok3,免登录,国内直连,不限地区/不限网络/不限设备,打开即用。

AIProxySwift★ 449

Swift clients for AI providers. You can make requests straight to the provider or proxied through our abuse protection backend

UltraCode-Shim★ 446

Give Claude Code's ultracode mode to ANY model you already pay for. A tiny local proxy + one config.json. Point your AI at AGENTS.md and it sets itself up.

ccLoad★ 443

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

AIProxySwift★ 436

Swift client for AI providers. Can make requests straight to the provider or proxied through our API key protection backend

antirion★ 429

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

UnlimitedGPT★ 427

An unofficial Python wrapper for OpenAI's ChatGPT API

prompt-cache★ 427

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

global-agent★ 421

Global HTTP/HTTPS proxy agent configurable using environment variables.

anthropic-proxy★ 416

Proxy server that converts Anthropic API requests to OpenAI format and sends it to OpenRouter. It's used to use Claude Code with OpenRouter instead of the Anthropic API

openai-proxy★ 412

openai-proxy is a solution provided for Chinese users to address the issue of being unable to make requests to the OpenAI API.

opencode2dsh★ 410

DSH plugin — free OpenCode Zen models for DeepSeek Harness (DSH). Free LLM API, no API key needed. 在 DSH 中使用 OpenCode Zen 免费模型,无需 API key

MAX-API★ 409

MAX API Next 社区是由来自科研机构和高校的 AGI 爱好者组织发起、维护和运营的研究驱动型技术社区,聚焦 AI Models 与 Agents 治理方向,致力于建设面向 AGI 应用时代的开放基础设施。社区关注多模型与多平台接入、国产模型持续适配、AgentOps 工程实践、成本审计、权限与安全边界、私有化部署和长期运营优化,目标是把模型服务、Agent 应用、用户组织和上游平台之间的共性治理问题沉淀为稳定、可复用、可持续演进的工程能力。

deepseek-laravel★ 403

Laravel wrapper for Deepseek PHP client, to seamless deepseek API integration with laravel applications.

webchat2api★ 400

OpenAI-compatible Web Chat API proxy with GPT, Grok, Gemini account management and Docker self-hosting

go-gpt3★ 386

An OpenAI GPT-3 API client enabling Go/Golang programs to interact with the gpt3 APIs.

ChatGPT.Net★ 383

C# library for ChatGPT using official OpenAI API

llm4free★ 382

LLM4Free — All-in-one Python toolkit for web search, AI interaction (40+ free providers), digital utilities, and more. Formerly WebScout.

tingly-box★ 382

Your Intelligence, Orchestrated. Any Model, Any Agent, Any One.

Deepseek-API★ 381

Reverse engineered Deepseek chat into an OpenAI compatible API. Access V4 and R1 models through a simple REST interface without API keys or billing.

smg★ 378

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

openlm★ 370

OpenAI-compatible Python client that can call any LLM

openai4j★ 368

Java client library for OpenAI API.Full support for all OpenAI API models including Completions, Chat, Edits, Embeddings, Audio, Files, Assistants-v2, Images, Moderations, Batch, and Fine-tuning.

orbit★ 365

Self-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.

agent-vibes★ 363

Unified Agent Gateway — Enables Claude Code CLI and Cursor IDE to use free AI backends (Antigravity, Codex) through protocol translation

ccproxy★ 361

Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours

gemini-for-claude-code★ 356

This python program allows you to use Claude Code with Google's Gemini models.

claude-unlimited★ 356

Rotate Claude and GPT subscriptions and API keys seamlessly inside the Claude Code CLI — switch on usage limits without interrupting your session, all from a local dashboard. 100% local.

gpt-go★ 354

OpenAI ChatGPT/GPT-4/GPT-3 SDK Go Client to Interact with the GPT-4/GPT-3 APIs.

FreeQwenApi★ 352

Локальный API-прокси для Qwen AI с поддержкой сохранения контекста диалогов и управления сессиями через REST API

ClashRuleSet★ 347

Clash 分流规则,重点分流 AI服务、字节海外AI服务 、 WEB3 应用、教育类APP、开发者常用下载节点等分流服务

deepseek-free-api★ 345

将 DeepSeek 网页端免费对话(chat.deepseek.com)转换为 OpenAI + Anthropic 兼容 API(Chat Completions / Responses / Anthropic Messages)支持工具调用(Function Calling)、动态模型发现、PoW 自动求解、Token 自动刷新。

dsh-router-standard★ 345

已并入 dsh-routing-suite(单仓库化);本仓库为历史镜像/归档 —— 注意力工程主线 v1.19.1/v34 研发线未发布。新代码见 github.com/yjh051108/dsh-routing-suite

public-openai-client-php★ 335

OpenAI API Client for PHP. Includes all endpoints and models (DTOs) for all requests and responses.

doubao2api★ 335

Reverse-engineered Doubao (豆包) API → OpenAI-compatible REST service. Free multimodal chat, image/video/music generation, and file hosting for AI agents.

Quosparr★ 330

🐦 Native menu bar & tray app for macOS, Windows and Linux: track Codex, Claude, Gemini (Antigravity) and Grok quotas, resets, API-equivalent cost and local sessions, with multi-account and API relay switching | 原生 macOS、Windows、Linux 菜单栏与托盘应用,统一查看 Codex、Claude、Gemini(Antigravity)、Grok 额度、重置动态、API 等价成本与本机会话,支持多账号与中转 API 切换

jev-gateway★ 328

An easy way to use jev with your coding agent for tool calling reasoning

openai-cpp★ 327

OpenAI C++ is a community-maintained library for the Open AI API

CodexPool★ 323

有啥问题抖音私我,我后面攒起来更新

llmio★ 323

Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关,提供权重负载均衡、可观测性与费用追踪。

launchdock★ 322

Use Claude and GPT through one local gateway with OpenAI-compatible and Claude-native APIs.

DelphiOpenAI★ 319

OpenAI (and DeepSeek, Azure OpenAI, YandexGPT, Ollama, GigaChat, Qwen) API wrapper for Delphi. Use ChatGPT, DALL-E, Whisper and other products.

CatGPT-Gateway★ 318

Turn your ChatGPT or Claude account into a fully working OpenAI-compatible API. No API keys needed. Supports tool calling, vision, file attachments, and image generation.

token.js★ 313

Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.

codex-app-transfer★ 309

Local desktop gateway that translates OpenAI Codex CLI's Responses API into Chat Completions for Kimi / DeepSeek / Zhipu GLM / Bailian and other OpenAI-compatible providers.

munorai★ 308

Supercharge the AI you already use. Greener. Better. Faster. Cheaper.

fastapi★ 305

企业级 LLM API 快速集成系统,支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等,简洁的页面风格,轻量高效且稳定,支持Docker一键部署。

freebucks-proxy★ 304

[DEPRECATED / UNMAINTAINED] Multi-account gateway. No longer maintained; fork it and maintain yourself.

zen-gate★ 304

把 OpenCode Zen 免费模型装进你所有的 AI Agent —— Windows 托盘网关,OpenAI/Anthropic 兼容,自动适配 10+ Agent,限流自动切换

backdoor★ 303

Run Claude Code against any AI provider. DeepSeek, Groq, Ollama, OpenRouter — your call.

More in Agent frameworks & infrastructure