Agent frameworks & infrastructure

LLM gateways & API proxies

LLM gateways and API proxies put one endpoint in front of many model providers, translating requests into OpenAI-compatible formats and routing them by cost, availability, or key. Projects like LiteLLM and new-api add load balancing, usage tracking, and access control, while others such as CLIProxyAPI expose existing coding subscriptions as standard APIs.

4,018 agents · most starred first

Top 100 of 4,018

OmniRoute★ 89,059

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

dsh-our-free-model★ 81,643

在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and Kimi K3 among them. Completely free, with no usage cap.

OmniRoute★ 70,915

Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by hundreds of contributors

gpt4free★ 67,088

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

litellm★ 63,603

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

CLIProxyAPI★ 59,066

Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through API

new-api★ 52,267

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

GPT_API_free★ 46,416

免费大模型API,支持免费调用GPT、DeepSeek等主流模型,免费额度10000点,每日刷新!另付费价格最低官方1-2折!

magpie★ 39,409

Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.

claude-code-router★ 38,256

One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.

one-api★ 37,453

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI.

9router★ 32,658

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

opencodex★ 18,680

Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

codex-chatgpt-web★ 15,811

Use ChatGPT Web (including Pro) as a native model in Codex — with context, tools, streaming and images, without using Codex quota.

gateway★ 13,421

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

go-openai★ 10,809

OpenAI, GPT 6.1, GPT-Image-2, Whisper API clients for Go. Zero-dependency.

bifrost★ 9,803

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead

coai★ 9,344

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

AIClient2API★ 8,991

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro, OpenAI, Claude, and custom providers. Supports OpenAI-compatible API, Claude API, Gemini protocol conversion, GPT, Grok Build, Claude Opus, Gemini Pro, Kimi, MiniMax, provider pools, smart routing, and automatic failover.

llm-gateway★ 7,648

Open Source LLM Gateway 🦚

gpt4free-ts★ 7,638

Providing a free OpenAI GPT-4 API ! This is a replication project for the typescript version of xtekky/gpt4free

manifest★ 7,511

Connect Your Agents And Harnesses With Any Provider 🦚

gpt-load★ 7,239

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

plano★ 7,118

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

ClawRouter★ 6,665

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

ChatGPT★ 5,894

OpenAI API Free Reverse Proxy

router★ 5,625

Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

axonhub★ 5,481

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

AgnesAI-Models★ 5,300

Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows.

Bard-API★ 5,154

The unofficial python package that returns response of Google Bard through cookie value.

all-api-hub★ 5,075

All-in-one New-API/Sub2API account hub: balance/usage dashboard, auto check-in, one-click keys, price comparison, health checks, plus advanced channel management | 一站式 New-API/Sub2API 等中转站账号管理:余额/用量看板、自动签到、密钥一键使用、价格对比、可用性测试,另提供高级渠道管理

openai-java★ 4,703

OpenAI Api Client in Java

harnessrouter★ 4,393

HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.

optillm★ 4,345

Optimizing inference proxy for LLMs

PyChatGPT★ 4,178

⚡️ Python client for the ChatGPT API with, conversation tracking, proxy support and more.

node-chatgpt-api★ 4,141

A client implementation for ChatGPT and Bing AI. Available as a Node.js module, REST API server, and CLI app.

CPA-Manager-Plus★ 4,098

A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.

cascadeflow★ 3,923

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Gemini-API★ 3,833

✨ Reverse-engineered Python API for Google Gemini web app

EasyCLIProxyAPI★ 3,708

A desktop GUI for CLIProxyAPI and a tool for automatically configuring popular AI agents.

router★ 3,697

Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

openai-gemini★ 3,674

✦ Gemini ➜ OpenAI API proxy. Serverless!

OrcaRouter-Lite★ 3,491

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

codex-lb★ 3,457

Codex/ChatGPT multiple account load balancer & proxy with usage tracking, dashboard, and OpenCode-compatible endpoints

ChatGPTAPIFree★ 3,317

A simple and open-source proxy API that allows you to access OpenAI's ChatGPT API for free!

ruby-openai★ 3,218

OpenAI API + Ruby! 🤖❤️ GPT-5 & Realtime WebRTC compatible!

WindsurfAPI★ 3,155

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

cc-gateway★ 3,097

AI API identity gateway — reverse proxy that normalizes device fingerprints and telemetry for privacy-preserving API proxying

openai★ 3,022

.NET library for the OpenAI service API by Betalgo Ranul

OpenAI★ 2,965

Swift community driven package for OpenAI public API

workbuddy-manager★ 2,919

腾讯 CodeBuddy 账号池管理控制台,内置 OpenAI 兼容反代网关:扫码批量纳管账号、定时签到与保活、密钥分组分发、IP 与模型白名单、调用日志与用量统计;支持带签名校验的一键更新。

one-hub★ 2,898

OpenAI 接口管理 & 分发系统,改自songquanpeng/one-api。支持更多模型,加入统计页面,完善非openai模型的函数调用。

octopus★ 2,747

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

openai-openapi★ 2,587

OpenAPI specification for the OpenAI API

Agent2API★ 2,571

Local AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients through one base URL, with unified OpenAI / Anthropic / Images APIs, multi-account routing, check-in, balance and request reports · 本地 AI 路由网关 + Agent 客户端接管:复用各家客户端登录态,一个 base_url 调用 50+ 家模型额度,统一 OpenAI / Anthropic / 生图接口,多账号选路、签到、余额与请求报表一体管理

AIstudioProxyAPI★ 2,533

FastAPI + Playwright + Camoufox 中间层代理服务器,兼容OpenAI API且支持参数转发。项目通过浏览器自动化将API请求转发到 Google AI Studio Chat,并同样按照OpenAI标准格式返回的工具。内置调试WebUI面板。

api-for-open-llm★ 2,457

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

agent-router★ 2,422

Manages Unified Access to Generative AI Services built on Envoy Gateway

kiro-gateway★ 2,361

👻 Proxy API gateway for Kiro IDE & CLI (Amazon Q Developer / AWS CodeWhisperer). Use free Claude models with any client.

openrelay★ 2,328

几百个免费 AI 模型配额,一键接入本地项目。| Hundreds of free AI model quotas, one-click access to local projects.

any-llm★ 2,262

Communicate with an LLM provider using a single interface

meridian★ 2,208

Use Claude and Antigravity with Pi, OpenCode and other coding clients. Local API bridge, usage dashboard and Mac app. Antigravity preview available in 1.74.0.

fusio★ 2,132

Self-Hosted API Management for Builders

async-openai★ 2,037

Rust library for OpenAI

OpenAI-API-dotnet★ 1,890

An unofficial C#/.NET SDK for accessing the OpenAI GPT-3 API

APIPark★ 1,824

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用。

llmgateway★ 1,753

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

openclaw-termux★ 1,751

Run OpenClaw AI Gateway on Android — standalone Flutter app with built-in terminal, web dashboard, and one-tap setup. Also available as a Termux CLI package.

zilla★ 1,715

🦎 A lightweight, multi-protocol gateway for event-driven applications and AI agents. Expose and govern Kafka, MQTT, APIs, and MCP through one high-performance engine with shared routing, security, schema, and observability.

ninja★ 1,672

Reverse engineered ChatGPT proxy

openai-api-proxy★ 1,607

一行Docker命令部署的 OpenAI/GPT API代理,支持SSE流式返回、腾讯云函数 。Simple proxy for OpenAi api via a one-line docker command

ChatMock★ 1,566

OpenAI & Ollama compatible API powered by Codex

openai-oauth★ 1,442

Free AI with your ChatGPT account

paritok-4b-v1★ 1,439

Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

Grandet★ 1,427

Find the cheapest API for any model and connect it from your AI agent: Grandet Skill and an anonymous MCP server, backed by listed prices from 1,800+ official, inference and relay providers on grandet.ai.

WebAI-to-API★ 1,410

Webchat to API

ai-coding-welfare★ 1,377

AI Coding 福利站导航:免费白嫖 Claude Code / Codex 的中转站与公益站合集,含额度、模型、价格自动更新与一键配置脚本

PandoraHelper★ 1,346

使用 PandoraHelper 轻松和你的小伙伴共享 ChatGPT Plus/Claude Pro 服务!

gemini-business2api★ 1,335

OpenAI-compatible API for Gemini Business with multi-account load balancing and multimodal capabilities (image/video generation, file parsing) | 将 Gemini Business 转为 OpenAI 兼容接口,支持多账户负载均衡及多模态能力(图像生成、视频生成、解析文件)

litellm-agent-control-plane★ 1,335

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

azure-openai-proxy★ 1,331

Azure OpenAI Service Proxy. Convert OpenAI official API request to Azure OpenAI API request. Support GPT-4,Embeddings,Langchain. Adapter from OpenAI to Azure OpenAI.

GoModel★ 1,323

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

NeuroAPI★ 1,317

NeuroAPI: российский AI API для Codex CLI и Claude Code — безопасные one-click установщики для Windows и macOS.

claude-to-chatgpt★ 1,298

This project converts the API of Anthropic's Claude model to the OpenAI Chat API format.

himarket★ 1,297

HiMarket is an enterprise-level "AI Capability Marketplace and Developer Ecosystem Hub." It is not merely a simple aggregation of traditional APIs, but rather a comprehensive platform that packages, publishes, manages, and operates core AI assets such as enterprise Model APIs, MCP Servers, Agent APIs, etc., through standardized product formats.

codex-proxy-rs★ 1,279

基于 Rust 的低风控、高性能、自托管多账号透明代理网关

uni-api★ 1,273

This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.

Windows-Copilot-API★ 1,270

Reverse engineered Windows Copilot into an OpenAI-compatible API. Access GPT-4 and GPT-5 models through a simple REST interface without API keys or billing.

BricksLLM★ 1,232

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

proxypal★ 1,198

A desktop app that lets you use your AI subscriptions (Claude, ChatGPT, Gemini, GitHub Copilot) with any coding tool. Wraps CLIProxyAPI with a clean UI for managing connections and tracking usage.

copilot-api★ 1,129

GitHub Copilot, OpenAI Codex, OpenCode Go, and third-party AI provider gateway with OpenAI and Anthropic API compatibility.

VoAPI★ 1,094

🎉 全新下一代高颜值、高性能、高扩展的智能AI大模型API聚合分发系统 | A new next-generation high-value, high-performance, and highly scalable intelligent AI large-model API aggregation and distribution

poe-api-wrapper★ 1,088

👾 A Python API wrapper for Poe.com. With this, you will have free access to GPT-4, Claude, Llama, Gemini, Mistral and more! 🚀

ThinkWatch-Lite★ 1,073

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

CliRelay★ 1,062

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

AIHelms★ 1,037

企业级 AI 资源纳管平台,提供统一 AI网关、Token调度能力,纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型,并支持 MCP 工具与 Skill 的集中注册分发。具备内外双轨定价、成本归因、统一身份认证、安全审计与效能报表,帮助企业精准控制成本、量化 ROI,高效治理 AI 资产。

AI-Gateway★ 1,011

Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀

bedrock-access-gateway★ 1,003

OpenAI-Compatible RESTful APIs for Amazon Bedrock

zzz-api★ 992

企业级稳定的OpenAI、Claude、Gemini等的API接口-For企业和开发者。OpenAI的api proxy,支持ChatGPT的API调用,支持Anthropic claude的官方接口形式,支持Google gemini的官方接口形式,支持:gpt-5,sora。不需要openai Key, 不需要买openai的账号,不需要美元的银行卡,通通不用的,直接调用就行,稳定好用!!智增增

claude-desktop-multiple-windows-different-api★ 985

Multiple windows for Claude Desktop with different APIs at the same time: keep your official Claude subscription in one window and run other windows on custom / third-party APIs (cc-switch). Windows. 多开 Claude Desktop,多个窗口同时使用不同 API(官方订阅 + 第三方 API 同时工作)。

More in Agent frameworks & infrastructure