Agent frameworks & infrastructure
LLM gateways & API proxies
4,018 agents · most starred first
LLM gateways & API proxies, page 32 of 41
A simple interface for using the GPT API.
PyLLMCore provides a light-weighted interface with LLMs
A minimal, fast, and type-safe Python library for LLM chat completions across multiple providers
Simple LLM wrapper library
An unofficial Python wrapper for OpenAI's ChatGPT API
This Python3 module acts as a wrapper for ChatGPT API and will help you to use ChatGPT in your own language.
An unofficial Python wrapper for OpenAI's ChatGPT API for HEROKU
An unofficial API allowing free interaction with ChatGPT in Python
LiteLLM model integration for Pydantic AI framework - access 100+ LLM providers through a unified interface
A collection of unofficial models for pydantic-ai
A lightweight Pydantic AI model provider that routes requests to web-based LLMs (OpenAI, Google) through Temporal workflows.
Python Wrapper for the ChatGPT API
Standalone LLM library with support for multiple providers
A Simple Unified LLM API interface for OpenAI, Gemini, Mistral, Groq and more.
Python wrapper that downloads and launches the llm-link binary
Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Mistral, OpenRouter, Reka, Groq, Together, Ollama, AI21, Cohere, Aleph-Alpha, HuggingfaceHub), with a built-in model performance benchmark.
OpenAICompletion processor
The python package that returns Response of Anthropic Claude through API.
The python package that returns Response of Google Gemini through API.
The python package that returns Response of Google Gemini through API.
LLM please cast to JSON
An LLM wrapper for Humans
A flexible Python factory for working with multiple Large Language Model (LLM) providers (OpenAI, Anthropic, Gemini, Llama) using a unified interface, with robust configuration and extensibility.
Mistral Client Library
"The ChatGPT Requests module is a Python package that provides a convenient interface for making requests to the ChatGPT language model."
A simple example package with openai api key
Model manager compatible with Langchain models for Quackamollie Telegram chat bot
Model manager compatible with Llama-Index models for Quackamollie Telegram chat bot
Experimental libraries for communication with LLMs.
A barebones library to make interacting with OpenAI's ChatGPT API much simpler.
Qwen + Claude Code Router bootstrapper
A simple LLM client factory utility for use across QX applications
LLM ratelimiter for Python.
Unofficial reverse-engineered ChatGPT API in Python.
Python package for autofallback to local LLMs if OpenAI API or Azure Endpoint is not available
Multi-provider LLM batch prediction library
Error handling and auto-retry library for GPT
Remote LLM
LLMHub CLI — manage LLM specs and runtime configs
A lightweight runtime for LLMHub that delegates to any-llm
Unified Python SDK for chat completions across multiple AI providers
A fast LLM gateway
Production-grade cross-vendor failover for LLM APIs
Multi-format bidirectional LLM proxy — translates between OpenAI Chat, OpenAI Responses, and Anthropic Messages
A framework for serving and evaluating large language model routers.
Smart LLM request router — route prompts to the right model based on cost, speed, quality or complexity
A fast, modular, secure, and auditable toolkit to integrate with Azure OpenAI — with a friendly CLI and dev-first architecture.
Rustic AI module leveraging LiteLLM for LLMs
Yet another attempt at GPT in quantized latent space
Unified LLM connectors for OpenAI, Google Gemini, Ollama, and LM Studio.
Connect langchain to SAP's AI proxy.
A comprehensive multi-provider LLM proxy library with unified interface
A Python client library for SeekGPT and other OpenAI-compatible LLM APIs.
Universal LLM adapter service for Sekha AI - Multi-provider bridge supporting 100+ LLMs via LiteLLM
Add your description here
Semantic caching for LLM API calls - reduce costs with one decorator
A flexible LLM provider switching library
serapeum azure openai integration
serapeum openai integration
A package for using Openai in serverless environment
The Official Python Library For The SGLLM API.
The official Python library for the sgptcoder API
A small example package
A small example package
Smart AI router — filters requests to the right model, saving 40-80% on costs
Lightweight, easy, and consistent LLM-interface across providers and functionality.
Wrapper of the DeepAI GPT-2 text generation API.
A simple and easy-to-use LLM API Wrapper
A simple async and sync Mistral API client
Unify common OpenAI API requests use cases into a simple interface
A streamlined, lightweight LLM client library for OpenRouter and Ollama providers with structured output generation
sinapsis module to handle OpenAI modules for chat completion, image edition and creation, audio generation, among other tasks
SiteLLM= LiteLLM + Chinese + Security
Additional files for the SiteLLM Proxy. Please visit the sitellm project !
Package for SkorplandGPT Enterprise features
Additional files for the SkorplandGPT Proxy. Reduces the size of the main skorplandgpt package.
Zero-dependency LiteLLM-compatible facade for OpenAI, Anthropic, and OpenRouter
Provider-agnostic LLM router. Pick the cheapest capable model per prompt with rule-based scoring. Wraps LiteLLM for format conversion + streaming.
A unified async Python wrapper for multiple LLM providers with OpenAI Response API and reasoning support
A minimal Python library for interacting with various LLM providers
Semantic and exact caching for LLM calls — cut costs by catching duplicate and similar prompts.
Cross-runtime LLM orchestration for Python, TypeScript, and Rust with L2 caching, retries, key rotation, and config-driven runtime control
A proxy that wraps Solveit as an OpenAI-compatible LLM API
Python Client SDK Generated by Speakeasy
Async OpenAI client for fast and efficient API requests using AIOHTTP module.
A set of functions to better interact with openai.
StableOpenai is an enhanced framework for OpenAI, providing stable and efficient API request management. It allows the use of multiple API keys to increase request limits and ensures thread safety. The library features multi-key management, thread-safe operations for reliable requests in multi-threaded environments, and automatic fallback to alternate keys when API rate limits are reached. Ideal for developers looking to optimize interactions with OpenAI's services in robust, concurrent applications.
Anthropic provider for Stache AI
Bedrock provider for Stache AI
Cohere provider for Stache AI
Openai provider for Stache AI
Route LLM API calls through subscription-authenticated coding agents (Claude Code, Codex, Gemini CLI)
Superduper allows users to work with anthropic API models. The key integration is the integration of high-quality API-hosted LLM services.
Superduper allows users to work with cohere API models.
Superduper allows users to work with openai API models.
Mirrored key provider for Swarmauri
A blazing-fast universal LLM gateway — call OpenAI, Anthropic, Gemini, Mistral & Ollama through one unified API.
LangChain integration for the Synapse decentralized AI model marketplace. Wraps the Synapse orchestrator's /api/infer endpoint as a standard LangChain LLM.