Agent frameworks & infrastructure
LLM gateways & API proxies
4,018 agents · most starred first
LLM gateways & API proxies, page 19 of 41
Tree-shakeable static models.dev catalog split by provider for TokenLens.
This package provides a foundation for implementing providers that expose an OpenAI-compatible API.
Unified LLM API with automatic model discovery and provider configuration
Routiform — Smart AI Router with auto fallback — route to FREE & cheap models, zero downtime. Works with Cursor, Cline, Claude Desktop, Codex, and any OpenAI-compatible tool.
The **[Azure provider](https://ai-sdk.dev/providers/ai-sdk-providers/azure)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the Azure OpenAI API.
<p align="center"><code>npm i -g @openai/codex-responses-api-proxy</code> to install <code>codex-responses-api-proxy</code></p>
OpenAI-compatible providers (DeepSeek, Qwen, Gemma) for Robota SDK
A pure JavaScript BPE tokenizer with model metadata and pricing for GPT-5, GPT-4o, o-series, and other OpenAI models
OpenAI-compatible provider base for Metorial. Provides common functionality for OpenAI-compatible API providers.
AI orchestration across Claude + OpenAI subscriptions — smart routing, budget awareness, and dual-brain collaboration
Node.js library for the Azure OpenAI API
GitHub Copilot API OpenAI-Compatible Provider for AI SDK
Node client library for the Portkey API
Genkit AI framework plugin for Azure OpenAI APIs.
Helpers for context windows, usage normalization, compaction, and cost estimation.
Count the number of OpenAI tokens in a string. Supports all OpenAI Text models including GPT-5, GPT-4, GPT-3.5-turbo, and specialized models
OpenAI provider plugin for Tiny Claw
Typed client for models.dev to fetch model catalogs with friendly errors.
Conclave AI Grok agent — OpenAI-wire-compatible, routes to xAI's api.x.ai/v1 with strict-JSON-schema structured output.
Claude Language Agent Super Proxy - Translate Claude/Anthropic API calls to OpenAI-compatible endpoints
OpenAI Fastify plugin
Adaline OpenAI
WebSocket transport for the AI SDK OpenAI provider — drop-in fetch replacement that routes streaming requests through a persistent WebSocket connection.
Zero CLI to any LLM — OpenAI, Gemini, DeepSeek, Ollama, and 200+ models
Ollama agent router and local LLM router for OpenAI-compatible model routing, GPU-aware queues, async jobs, and CLI configuration.
Run Claude, Codex, or OpenCode as a local OpenAI-compatible HTTP provider for Hermes and other clients.
The **[Groq provider](https://ai-sdk.dev/providers/ai-sdk-providers/groq)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the Groq chat and completion APIs, transcription support, and browser search tool.
Anthropic SDK to multi-provider streaming bridge — converts Anthropic message format and tool calls to Gemini, OpenAI-compatible APIs
Unified LLM API with automatic model discovery and provider configuration
Cherry Studio AI Core - Unified AI Provider Interface Based on Vercel AI SDK
Unified LLM API with automatic model discovery and provider configuration
Tools for working with OpenAI streams in Node.js and TypeScript.
GitHub Copilot, OpenAI Codex, OpenCode Go, and third-party AI provider gateway with OpenAI and Anthropic API compatibility.
A tiny client module for the openAI API
ACP to OpenAI protocol conversion gateway - expose ACP agents as OpenAI-compatible API endpoints
AI Agents discover, invoke, and settle paid LLMs, APIs, and Skills — starting with Skill Boss. No manual key setup. No prepayment. Pay-per-call via x402 or Agent Card.
Smart LLM router — save 85% on inference costs. 55+ models (11 free), one wallet, x402 micropayments.
The Gateway provider for the [AI SDK](https://ai-sdk.dev/docs) allows the use of a wide variety of AI models and providers.
The **[Anthropic provider](https://ai-sdk.dev/providers/ai-sdk-providers/anthropic)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the [Anthropic Messages API](https://docs.anthropic.com/claude/reference/messages_post).
The **[xAI Grok provider](https://ai-sdk.dev/providers/ai-sdk-providers/xai)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the xAI chat and completion APIs.
The **[Amazon Bedrock provider](https://ai-sdk.dev/providers/ai-sdk-providers/amazon-bedrock)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the Amazon Bedrock [converse API](https://docs.aws.amazon.com/bedrock/latest/APIR
AI SDK v7 provider for OpenCode 2.x via @opencode/client: sessions, streaming, tool approvals, and interactive forms
The **[Mistral provider](https://ai-sdk.dev/providers/ai-sdk-providers/mistral)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model, embedding model, and speech model support for Mistral APIs.

The **[DeepSeek provider](https://ai-sdk.dev/providers/ai-sdk-providers/deepseek)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the [DeepSeek](https://www.deepseek.com) platform.
The **[Google Vertex provider](https://ai-sdk.dev/providers/ai-sdk-providers/google-vertex)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the [Google Vertex AI](https://cloud.google.com/vertex-ai) APIs.
The **[Cohere provider](https://ai-sdk.dev/providers/ai-sdk-providers/cohere)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the Cohere API.
The **[Together.ai provider](https://ai-sdk.dev/providers/ai-sdk-providers/togetherai)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the [Together.ai](https://together.ai) platform.
The **Cerebras provider** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for [Cerebras](https://cerebras.ai), offering high-speed AI model inference powered by Cerebras Wafer-Scale Engines and CS-3 systems.
Google AI JavaScript SDK
The official TypeScript library for the Anthropic API
The **[Fireworks provider](https://ai-sdk.dev/providers/ai-sdk-providers/fireworks)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model and image model support for the [Fireworks](https://fireworks.ai) platform.
The **[Perplexity provider](https://ai-sdk.dev/providers/ai-sdk-providers/perplexity)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for Perplexity's Sonar API - a powerful answer engine with real-time web search capabilities.
Vertex Generative AI client for Node.js
The **[DeepInfra provider](https://ai-sdk.dev/providers/ai-sdk-providers/deepinfra)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-th
The Firebase AI SDK
IBM watsonx.ai Node.js SDK
The official TypeScript library for the Anthropic Vertex API
AI Gateway Provider for AI-SDK
The official TypeScript library for the Anthropic Bedrock API
The **[Baseten provider](https://ai-sdk.dev/providers/ai-sdk-providers/baseten)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model and embedding model support for the [Baseten](https://baseten.co) platform.
Retry and fallback mechanisms for AI SDK
Community AI SDK provider for Google Gemini using the official CLI/SDK
Google Gemini adapter for TanStack AI chat, images, speech, audio generation, and structured outputs.
Dify provider for Vercel AI SDK
TypeScript client library for the Mistral AI API
Venice AI provider for the Vercel AI SDK
Multi-channel AI gateway with extensible messaging integrations
The **[Hugging Face Inference Providers](https://huggingface.co/docs/inference-providers/index)** for the [Vercel AI SDK](https://ai-sdk.dev/docs) contains language model support for thousands of models through multiple inference providers via the Hugging
<div align="center"> <a href="README.md">🇺🇸 English</a> | <a href="README.zh.md">🇨🇳 中文</a> | <a href="README.ja.md">🇯🇵 日本語</a> </div>
A Firebase SDK for VertexAI (preview)
SAP AI Core provider for AI SDK (powered by @sap-ai-sdk/orchestration)
A Firebase SDK for VertexAI
The **[Moonshot AI provider](https://ai-sdk.dev/providers/ai-sdk-providers/moonshotai)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the [Moonshot AI](https://platform.moonshot.cn) platform, including the Kimi model serie
Vercel AI Provider for running MiniMax AI models
Forked from https://github.com/OpenRouterTeam/ai-sdk-provider
Vercel AI SDK Custom Provider for Services from Zhipu (Z.ai)
Multi-channel AI gateway with extensible messaging integrations
The official TypeScript library for the Anthropic Foundry API
[nalaso/anthropic-vertex-ai](https://github.com/nalaso/anthropic-vertex-ai) is a community provider that uses Anthropic models through Vertex AI to provide language model support for the Vercel AI SDK.
 
TanStack AI adapter for OpenRouter chat, provider tools, structured outputs, and access to hundreds of LLMs.
Cherry Studio AI SDK provider bundle with CherryIN routing.
The translation layer for LLM provider messages
Multi-channel AI gateway with extensible messaging integrations
Workers AI Provider for the vercel AI SDK
Automatically switch AI SDK model provider when one of the providers has downtime
ai sdk compatible provider for azure(non OpenAI models)
The **[Open Responses provider](https://ai-sdk.dev/providers/ai-sdk-providers/open-responses)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for [Open Responses](https://www.openresponses.org/) compatible APIs.
Multi-agent gateway for Claude
Standalone daemon for multi-client, multi-agent access
Unified Agent Gateway - Multi-Agent Scheduler and Router
xAI / Grok extras for Pi — Grok Build protocol, Imagine tools, usage QoL, agentic APIs (provider transitional)
Agent Gateway — multi-agent task router for Claude, Codex, Gemini with combos, DAG, DSL
Multi-agent orchestration gateway
Multi-agent orchestration gateway
Seracade is a drop-in OpenAI-compatible routing proxy for AI agent teams. Six named capabilities: Call (every request, addressable and replayable), Step (sub-Call routing context inside agent trajectories), Quality Score (calibrated, version-stamped quali
Drop-in Tessera integration for the Vercel AI SDK. One line of config routes generateText / streamText / generateObject / streamObject through Tessera's auto-route + auto-cache + auto-compress + auto-batch proxy. Compatible with @ai-sdk/openai, @ai-sdk/an
Drop-in Tessera integration for the Mastra agent framework. One line of config routes every Mastra Agent's LLM calls through Tessera's auto-route + auto-cache + auto-compress + auto-batch proxy. Compatible with @ai-sdk/openai, @ai-sdk/anthropic, @ai-sdk/m
Node.js SDK for SatGate Gateway and SatGate Cloud private-beta APIs