Agent frameworks & infrastructure
LLM gateways & API proxies
4,018 agents · most starred first
LLM gateways & API proxies, page 35 of 41
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
Google-OAuth-gated LLM gateway: verify a Google ID token, then run a Gemini (Vertex AI) completion for the verified caller.
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
TypeScript SDK and CLI for Tangle Router, Sandbox, model routing, and agent service calls
Google-OAuth-gated LLM gateway: verify a Google ID token, then run a Gemini (Vertex AI) completion for the verified caller.
Production LLM calls. Just the three lines. Reliability, native caching, and reversible context compression on by default.
Run any agent (Claude, Codex, custom) on any machine — with no API key on the machine. A secure, self-hosted proxy for models and tools.
Local AI compute control plane for Claude Code and coding agents. Route subagents across your Macs, GPUs, and Ollama nodes — with real-time fleet health, role-based routing, model warmup, and execution tracing.
Claudin — Claude Code opened to any LLM (OpenAI, Gemini, DeepSeek, Ollama, and 200+ models)
The **[Claude Platform on AWS provider](https://ai-sdk.dev/providers/ai-sdk-providers/anthropic-aws)** for the [AI SDK](https://ai-sdk.dev/docs) gives you access to the Anthropic Messages API hosted in AWS at `aws-external-anthropic.{region}.api.aws`, aut
OpenCode plugin that exposes Tabnine Agentic as a provider
Autourgos LLM wrapper for the OpenAI Chat Completions API
Heal broken Vercel AI SDK message arrays before they hit the provider. Fixes orphaned tool calls, missing reasoning signatures, invalid tool names, and other provider rejections.
kubectx-like CLI for switching Codex auth profiles
AutoGen (AG2) model client for JarvisClaw AI API (x402 USDC payments supported)
CrewAI LLM integration for JarvisClaw AI API (x402 USDC payments supported)
OpenAI SDK-style Python client for ChatGPT/Codex OAuth-backed Responses workflows.
LangChain integration for JarvisClaw AI API (x402 USDC payments supported)
Nexus Cortex CLI - Terminal interface for multi-provider LLM orchestration
Unified LLM API with automatic model discovery and provider configuration
Library to easily interface with LLM API providers
Async LLM backend abstraction with Retry-After aware clients.
A pre-spend GATE + learning advisor for LLM API cost: caps every call, prices from a verified table, and learns the cheapest config that keeps quality.
Qode — LLM provider abstraction layer (Anthropic, OpenAI, Google, Ollama, etc.)
Access AI models, email services, and project thumbnail capture through vly.ai and freebuff.com without managing multiple API keys or accounts
OpenAI adapter using the official OpenAI Node SDK for agentic chat completions.
Prompt-aware LLM routing-decision service: predicts which model can complete a prompt and picks the cheapest one.
Native LangChain BaseChatModel adapters for the Claude Code OAuth subscription (Anthropic) and opencode/Zen — no Pi, no API key.
Local-first LLM router: keep sensitive data and bulk text labor on your own models, call the cloud only for the hard part. Privacy-routing (fail-closed) + manager-worker delegation + allowlist guard, MCP-native.
Быстрый доступ к LLM через api.llm7.io без API-ключа
Thin, file-based CLI that routes a multi-step article workflow (brief → outline → draft → review → final) across OpenAI and Anthropic with fallback, schema validation, judge-model evaluation, and platform profiles (Qiita/Zenn/blog/note).
Model provider routers and fallback registry mechanisms for Nanio agentic framework (v0.0.1-alpha.4)
Centralized API provider management for AI coding agents
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
Scriptable LLM multiplexer — unified interface to Claude and OpenAI via subscription OAuth
ローカルLLM(mlx / mlx-vlm / llama.cpp / vLLM / SGLang)を OpenAI 互換 API で束ねるマルチモデルゲートウェイ(サーバー)。gateway.toml のカタログを 1 ポートで配信し、model で振り分け・遅延起動・LRU 退避・MTP 高速化(Ollama 流の共有デーモン)。接続用クライアントは別パッケージ local-llm-client。
Fault-tolerant streaming wrapper for the official OpenAI Python SDK.
OpenAI-compatible Chat Completions adapter for host responders.
Local Python SDK and CLI bridge for authenticated consumer AI web products and hosted capabilities.
ローカル LLM ゲートウェイ(local-llm-server / OpenAI 互換)に繋ぐ高レベルクライアント。エージェント共通のクライアントで、openai のボイラープレートを再実装しない(chat・画像・動画・音声認識/STT)。
Haystack integration for orcarouter
AI Setu client — drop-in OpenAI SDK with workspace credit accounting and multi-provider routing.
The AnyRouter provider for the Vercel AI SDK — call every AnyRouter model through `createAnyRouter`.
AgentSave InferRoute — PPD append-prefill routing sidecar for vLLM / SGLang (Enterprise)
Axemere AI Gateway Anthropic SDK wrapper — drop-in Anthropic/AsyncAnthropic subclasses
Axemere AI Gateway LangChain integration — ChatAiGateway BaseChatModel
Axemere AI Gateway OpenAI SDK wrapper — drop-in OpenAI/AzureOpenAI subclasses
Claude Code API for fastllm
LLM provider adapters for GAARD
LLM plugin for Gonka Broker - OpenAI-compatible access to open-source models on the decentralized Gonka network
Transparent OpenAI Chat Completions proxy and response normalizer
TrimPrompt — Save 80% on LLM tokens. Zero-config CLI proxy for AI coding agents
Custom Provider CLI for managing model providers
OpenAI / GPT provider for chat completions.
Use Vercel AI SDK streamText directly on the client — no server required
Isomorphic (Node + browser) JavaScript/TypeScript client for the WEB6 OASIS AI Layer API v3.0 — 17 modules, 47 operations covering: unified AI completion across 99 providers (OpenAI, Anthropic, Gemini, Grok, Mistral, SambaNova, OpenRouter, Together AI, Pe
Expose any Agent Client Protocol (ACP) agent behind an OpenAI-compatible /v1 API
Aether Core AI v110 — Universal AI Gateway CLI (Python Wrapper)
Batch processing for LLM APIs - CSV/JSONL in, processed out. With retries, rate limiting, and cost tracking.
Cost-aware model routing for the Claude API — reference implementation with a Claude Code subagent hook
Google-OAuth-gated LLM gateway: verify a Google ID token, then run a Gemini (Vertex AI) completion for the verified caller.
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
Cached LLM client with Ollama + Anthropic provider dispatch, fixture mode, and JSON-schema-strict completions.
LangChain integration for XYNQ — decentralized OpenAI-compatible inference.
Generic OpenAI-compatible endpoints (OpenRouter, Together, Groq, self-hosted vLLM/TGI, ...) as a first-class Langflow model provider, packaged as a standalone Extension Bundle.
A global reusable LLM Registry wrapper for LangChain models with unified error mapping for Lighthouse Agents Factory
Gateway-agnostic core for llm-catalog: config schema, resolver, GatewayTransport, and LiteLLM codegen. Knows nothing about any runtime adapter.
LiteLLM CustomLLM plugin for llm-catalog: drive a catalog config through LiteLLM, in-process or via the proxy.
Pydantic AI adapter for llm-catalog: build native Pydantic AI models from a catalog config, routed through your gateway.
Open clearinghouse for LLM bids, councils, and evidence-backed routing.
Run any LLM with one config file. No framework lock-in.
Unified multi-provider LLM caller with automatic fallback
LangChain BaseChatModel adapter for somm — lets LangChain/LangGraph/deepagents apps use somm as their LLM substrate
Policy-first OpenAI-compatible gateway for regulated workloads
A smart, OpenAI-compatible LLM router — a tiny triage-verify-escalate agent that saves cost without losing quality.
An OpenAI-compatible chat completions server that logs harness traffic (dumb or MITM).
LLM Router integration plugin for agent-budget-controller
ZevaiRouter - AI Router with provider automation, multi-account workflows, and quota tracking
Model providers for lite-agent: Anthropic Messages API + OpenAI Chat Completions (also OpenAI-compatible / local endpoints).
Unified LLM API with automatic model discovery and provider configuration
Provider adapter contracts and implementations for the Plasius agentic AI package family.
Google-OAuth-gated LLM gateway: verify a Google ID token, then run a Gemini (Vertex AI) completion for the verified caller.
Login to ChatGPT with email:password, get access token + cookies
JWT-gated LLM gateway: authenticate (bcrypt/JWT), then run a LangChain-on-Vertex Gemini completion. Unauthenticated calls are rejected.
Azure OpenAI Target adapter for Waken — routes waken Events to an Azure-hosted OpenAI deployment.
AWS Bedrock Target adapter for Waken — routes waken Events to any Bedrock-hosted model via the Converse API.
Claude Target adapter for Waken — routes waken Events to the Claude Agent SDK.
Cohere Target adapter for Waken — routes waken Events to Cohere's chat API.
Gemini Target adapter for Waken — routes waken Events to Google's google-genai SDK.
Groq Target adapter for Waken — routes waken Events to Groq's fast inference API.
Mistral Target adapter for Waken — routes waken Events to Mistral AI's chat API.
OpenAI Target adapter for Waken — routes waken Events to the OpenAI Responses API.
ApexApi review: compare features, pricing, use cases, access model, and alternatives for this Model Serving agent in 2026. One API key for 120+ AI models plus live web data. OpenAI-compatible.
Local Claude Code Router gateway with CLI and web management UI.
AI SDK (Vercel) provider for Mixlayer — open-weight text and vision model inference over an OpenAI-compatible endpoint.
Transparent wrapper for the OpenAI Python SDK to inject CaesuraO recommendations.
LangChain integration for Concentrate.ai — a unified LLM gateway with the OpenAI Responses API.
🐙 Universal AI Agent Connector - one key, many agents (OpenCode, Hermes)