Agent frameworks & infrastructure
LLM gateways & API proxies
4,018 agents · most starred first
LLM gateways & API proxies, page 28 of 41
A thin, fast, observable Python client for LLMs
Access fireworks.ai models via API
Small CLI playground for Qwen via an OpenAI-compatible LLM Forge gateway.
A configurable forwarder for OpenAI-compatible LLM requests
This is LLM Gateway package
LLM plugin for Google Cloud Vertex AI models including Gemini and Model Garden
LLM plugin to access Google's Gemini family of models
LLM plugin to access Google's Gemini via Code Assist API with OAuth
GitHub Copilot plugin for LLM CLI tool
LLM plugin to access GitHub Models API
A plugin to add support for the GreenPT AI inference service to llm
LLM plugin providing access to Grok models using the xAI API
A unified handler for LLM API calls across OpenAI, Anthropic, and Google
Plugin for LLM adding models hosted on AI Horde
HTTP API for LLM with OpenAI compatibility
This Python SDK that provides convenient clients for interacting with the LLM-HUB – a centralized backend service
LLM plugin providing access to the huggingface inference API
LLM plugin to access Hugging Face models
Access hyperbee.ai models via API
LLM access to Hyperbolic's API
LLM plugin for iaedu.pt API — no adapter required
Run prompts against LLMs hosted by Inception Labs with diffusing animation
LLM plugin for models hosted by Inference
Pluggable LLM inference routing SDK — bring any model from any provider
A flexible interface for working with various LLM providers
A lightweight Model I/O normalization layer for OpenAI-compatible LLM calls.
LLM plugin for Jina AI
A JSON library wrapper that gracefully handles markdown-wrapped JSON from LLMs.
使用 LLM 修正 json 文件
A simple utility to fix malformed JSON from LLM outputs
Production-safe JSON repair and schema validation for LLM outputs
Robust JSON parsing for LLM outputs with automatic repair and field extraction
A unified interface for streaming structured JSON from OpenAI, Anthropic, and Google Gemini.
Fast, minimal JSON repair implemented in Rust (PyO3), focusing on truncation and trailing comma fixes.
Free-tier LLM API key pool with rotation, cooldown, and LangChain drop-in
A unified toolkit for working with multiple LLM providers
LLM access to LAMBDA's API
Run prompts against LLMs hosted by https://lambdalabs.com/
A thread-safe and async rate limiter for Gemini and OpenAI models.
A Python package to list and monitor available LLM models from various providers
LLM plugin for LiteLLM proxy server
LLM plugin for LiteLLM OpenAI-compatible proxies
LLM MIME types
LLM plugin for accessing MiniMax models via their API
LLM plugin providing access to Mistral models using the Mistral API
Standalone model alias resolver
Filter llm models list by starring favorites
OpenAI-compatible API server for simonw's llm cli
Intelligent multi-LLM request router for cost optimization
A CLI tool to list available LLM models from various providers
Run prompts against LLMs hosted by Moonshot
LLM API for multiple model providers
A plugin to add support for the Neuralwatt AI inference service to llm
A unified interface for multiple language model providers
LLM plugin for models hosted by NOS Cloud
Access Nous Research models via API
OneSDK is a Python library that provides a unified interface for interacting with various Large Language Model (LLM) providers.
Conditionally serve content to LLM crawlers in Python web frameworks.
Access OpenAI models via a Codex subscription
LLM plugin for OpenAI
Access OpenAI models via a Codex subscription
LLM plugin for models hosted by OpenRouter
Plugin for LLM adding support for Google's PaLM 2 model
A library to parametrize multiple API calls for LLMs
A package to route chat requests between LLMs based on prompt classification
A unified interface for multiple LLM providers
A unified interface for multiple LLM providers with image generation, speech-to-text, and function calling (OpenAI, Anthropic, Gemini, VertexAI, Ollama + DALL-E, Replicate, Whisper, Google Speech, Tools)
A unified source of truth for LLM providers, models, pricing, and capabilities.
A lightweight LLM proxy with logging and admin dashboard
A FastAPI proxy server for vLLM w/wo SLURM support and automatic process management
LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.
llm proxy server
A cacheing CLI for quickly asking questions of LLMs
The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.
Cloud-agnostic rate limit mitigation for LLM APIs
A centralized registry for discovering and managing LLM model capabilities. Track model features, costs, and limitations across providers like OpenAI and Anthropic. Supports both verified model definitions and user-managed entries with local storage.
Access Reka models via the Reka API
Unified LLM usage management — API proxy, session diagnostics, multi-CLI orchestration.
LLM plugin for models hosted on Replicate
llm req client
LLM plugin for models hosted by requesty
Exponential backoff with full jitter for LLM API calls. Sync + async. Built-in retryable-code presets for Anthropic, OpenAI, Bedrock, Gemini. Zero runtime deps.
LLM-Rosetta: Unified LLM API adapter — bidirectional conversion between OpenAI, Anthropic, and Google formats via intermediate representation (IR).
Unified LLM client with key rotation, health-aware failover, and multi-provider orchestration.
Fault-tolerant LLM provider rotation with circuit breaker, quotas, and model-first routing
Intelligent LLM routing with weighted least-outstanding selection, 429 cooldown, and request class isolation
Quick LLM routing using Embeddings
Route text and embedding calls across LLM providers, keeping a JSONL ledger of every request and response for offline cost reconciliation.
LLM plugin exposing the RovoDev model for the llm CLI
LLM plugin providing access to the free Samba models using the samba API
LLM plugin for models hosted by SambaNova
Gemini provider plugin for llm-sdk.
A Python library for selecting the best LLM model based on user input using any LLM via LiteLLM
輕量級 LLM 模型追蹤與自動替換 Decorator