Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 22 of 41

casual-llm

Lightweight LLM provider abstraction with standardized message models

cava-llm-manager
ccopenai

The official Python library for the openai API

ccs-llmconnector

Lightweight wrapper around different LLM provider Python SDK Responses APIs.

celeste-anthropic

Anthropic provider package for Celeste AI

celeste-cohere

Cohere provider package for Celeste AI

celeste-mistral

Mistral provider package for Celeste AI

celeste-openai

OpenAI provider package for Celeste AI

central-tools-llm

Centralized routing, retry, and API cycling utilities for LLM integrations

centralized-llm-client

Unified Python client for multiple LLM providers with fallback, file handling, and logging.

chatGPTKS

这个包对api进行了封装,供公司内部使用

chatgpt-anon

Intreract with ChatGPT anonymously

chatgpt-api

ChatGPT HTTP API Client and CLI

chatgpt-block
chatgpt-client

Python client for the unofficial ChatGPT API.

chatgpt-proxy

Reverse proxy for OpenAI chatgpt website API

chatgpt-serpucga

Client library to communicate with the ChatGPT API

chatgpt-uoapi

Short description of your package.

chatgpt-utils
chatgpt-wrapper

A wrapper for chatgpt with logging, caching and more pythonic output parsing

chatgpt_hj3415

chatgpt-hj3415 is the program using chatgpt api.

chatgptdevfriendly

A wrapper package which takes care of API call robustness to ensure developers quickly and easily develop CHatGPT based applications.

chatgpthon

A package to facilitate integration with chatgpt

chatgptmax

Take large input or read a file and send it in chunks to ChatGPT.

chatgptonic

A package to facilitate integration with chatgpt

chatgptos

Python client for ChatGPT Open-Source 1.0 API

chatgptprtk

A python wrapper around OpenAI ChatGPT for easy access of its functionality

chatgptpy

⚡️TLS-based ChatGPT API with auto token regeneration, conversation tracking, proxy support and more.

chuk-llm

A unified Python library for Large Language Model (LLM) providers with real-time streaming, function calling, middleware support, automatic session tracking, dynamic model discovery, and intelligent system prompt generation.

claude-2-api

Claude api with the new 2.1 model referring to a non-working repo: https://github.com/KoushikNavuluri/Claude-API

claude-api

An unofficial API for Claude AI, allowing users to access and interact with Claude AII

claude-api-py

Unofficial Anthropic Claude API for Python3.

claude-api-temp

An unofficial API for Claude AI, allowing users to access and interact with Claude AII

claude-bedrock-cli

A powerful CLI for Claude AI using AWS Bedrock - no Anthropic subscription needed

claude-bridge

API gateway for Claude Code with Anthropic API compatibility

claude-ccproxy

Scriptable Claude Code LiteLLM-based proxy

claude-code-fallback

Automatically switch from Claude subscription to API billing when you hit usage limits

claude-code-gemini

Proxy that translates between Claude Code and Gemini API

claude-code-llm-router

Multi-LLM router MCP server for Claude Code — smart complexity routing, Claude subscription monitoring, Codex integration, 20+ providers

claude-code-mate

Claude Code Mate (CCM) - A companion tool for Claude Code, enabling flexible LLM integration through LiteLLM proxy.

claude-code-proxy

Connect Claude Code to alternative models from OpenAI or Gemini.

claude-code-relay

Local proxy that exposes Claude CLI as an OpenAI-compatible API server

claude-codex-local

Local backend bridge for Claude Code, Codex, and Pi.

claude-max-proxy-py

OpenAI-compatible API proxy for Claude Max. Wraps Claude Code CLI — zero API keys needed.

claude-model-selector

Intelligent model selection for optimal cost-effectiveness with Anthropic's Claude AI

claude-mux

Claude Proxy Router - 智能代理路由器

claude-oneclick

VPN-style one-click toggle to route Claude Code (CLI + VSCode) to custom model endpoints (DeepSeek, NVIDIA NIMs, OpenRouter, Ollama, ...).

claude-openai-bridge

Claude API to OpenAI API adapter

claude-openai-proxy

Thin OpenAI-compatible API proxy backed by Anthropic Vertex AI

claude-openrouter-tool

A tool to manage OpenRouter integration with Claude Code.

claude-or

Route Claude Code through OpenRouter to alternative models

claude-pipe

A pip-installable Python CLI that pipes stdin into Claude with Pydantic-validated structured outputs.

claude-proxy

A production-ready Claude API proxy server

claude-re

Claude API reimplementation

claude-relay

Compatibility package; use agentrelay-cli

claude-rotator

Run Claude CLI subprocesses with automatic multi-account rotation and rate limit handling

claude-router

Claude prompt router that chooses the right model tier and scaffold using local embeddings.

claude-select

Manage a local registry of Claude CLI auth snapshots plus simple SDK token entries.

claude-shop

CLI launcher for Claude Code through the claude.shop proxy.

claude-switch

Anthropic Claude API 配置管理工具,支持多环境切换

claude-switchboard

claude-switchboard: multi-account manager for Claude Code CLI profiles

claude-switcher

Claude模型切换器 - 在不同的Claude模型之间自由切换

claude-to-openai-forwarder

A FastAPI service that translates Claude Messages API requests to OpenAI-compatible chat completions endpoints

claude-webapi

Async Python wrapper for the Claude.ai web app

claude-wrapper

A simple Python wrapper for Claude CLI with streaming support and OpenAI-compatible API interface

claude2

A Python package provides an unofficial api for interacting with the Claude from Anthropic

claude2api-client

Python client for claude2Api bridge service

claude2openai

use claude like openai

claudefucker

Anthropic格式AI代理服务器 - 将Claude Code请求转换为各厂商格式

claudeprobridge

OpenAI-compatible API bridge for Claude using OAuth tokens

claudewarp

Claude API proxy management tool with CLI and GUI

claudewarp-cli

Claude API proxy management tool with CLI

clearllm

A lightweight, provider-agnostic LLM client library

cli-llm

A placeholder package to reserve the name llms.

client-GPT

A package for working with GPT language models.

cnlitellm

A Python library for unified access to Chinese domestic large language models.

cnllm

Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.

codex-openai-server

OpenAI-compatible HTTP server backed by locally authenticated ChatGPT Codex.

codex2claude

Local Codex-to-Claude bridge CLI

coec-llmhub

Add your description here

coffee-with-llm

A model-agnostic Python library with a unified API for multiple LLM providers

combo-llm

combo Chinese llms

cometapi-haystack

Use Comet API with Haystack to build AI applications with 500+ AI models.

concurrent-openai

Python library for asynchronous interactions with the OpenAI API, enabling concurrent request handling. It simplifies building scalable, AI-powered applications by offering efficient, rate-limited access to OpenAI services. Perfect for developers seeking to integrate OpenAI's capabilities with minimal overhead.

copaw-openai-compat

OpenAI compatible provider templates for CoPaw - dynamic injection without modifying core code

custom-aoai-gpt4mm

Custom Azure OpenAI Multi-Model support LLM tool.

custom-call-for-llm
custom-llm-call-or-llm-invocation
customgpt-client

A client library for accessing customgpt

customgroqchat

Python client for the Groq Cloud API with intelligent rate limiting

cyborgmarina-litellm

A fork of BerriAI's litellm library, with specific features needed for some projects.

czzOpenAi

The czczz Python library for the openai API base on openAI v1.43.0

darca-llm

LLM Client for chat responses with support for different clients and models.

data-agent-tunnel-client

Data Agent Tunnel client - proxy local web services to public network

databricks-openai

Support for Databricks AI support with OpenAI

datadog-litellm
datasette-llm-limits

Plugin for configuring periodic limits on LLM usage in Datasette

datugokugpt

Python wrapper for the DatugokuGPT API

davinciGPT

davinciGPT uses API from OpenAI and help you easily integrate it in your python project.

daz-agent-sdk

Provider-agnostic AI library with tier-based routing and automatic fallback.

More in Agent frameworks & infrastructure