Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 25 of 41

kestrel-llm-deepseek

DeepSeek LLM provider plugin for Kestrel Sovereign.

kestrel-llm-kimi

Moonshot Kimi LLM provider plugin for Kestrel Sovereign.

kestrel-llm-openai-compat

Shared OpenAI-compatible helpers for Kestrel LLM provider plugins.

kestrel-llm-vertex

Google Vertex AI LLM provider plugin for Kestrel Sovereign.

kestrel-llm-xai

xAI Grok LLM provider plugin for Kestrel Sovereign.

kestrel-llms

Convenience extras for Kestrel Sovereign LLM provider plugins.

kiro-openai-gateway

OpenAI-compatible proxy gateway for Kiro IDE API (AWS CodeWhisperer)

kloom-litellm

A LiteLLM plugin for intelligent model routing and request tracking with Kloom

kraken-llm

Universal LLM framework with full OpenAI API support

ks-openai

A Python wrapper for OpenAI-like API with custom access key management

kuafu-llm-infra

LLM infrastructure layer with multi-provider fallback, health monitoring, speed probing, and alerting.

kuhl-haus-bedrock-api

OpenAI-compatible REST API using AWS Bedrock as a backend

kuhl-haus-bedrock-app

Application layer abstraction for integrating with AWS bedrock APIs

langchain-0g

Official Langchain client for 0g.ai Inference SDK

langchain-alephantai

LangChain integration package for Alephant AI Gateway.

langchain-amvera

LangChain интеграция для Amvera LLM API с поддержкой LLaMA и GPT моделей

langchain-anyllm

An integration package connecting LangChain with AnyLLM

langchain-brainiall

LangChain integration for Brainiall LLM Gateway - 113+ AI models from 17 providers

langchain-budgetforge

Langchain integration for BudgetForge API with budget enforcement

langchain-crusoe

An integration package connecting Crusoe AI and LangChain

langchain-crynux

LangChain ChatOpenAI wrapper for Crynux.

langchain-custom-models

Custom Langchain chat models for various large model service providers

langchain-dartmouth

LangChain components for Dartmouth-hosted models.

langchain-deepai

LangChain integration for DeepAI API with chat, images, and speech capabilities

langchain-deepinfra

An integration package connecting DeepInfra and LangChain

langchain-deepseek

An integration package connecting DeepSeek and LangChain

langchain-deepseek-extension

This project supports the calculation of token counts.

langchain-deepseek-official

An integration package connecting DeepSeek and LangChain

langchain-deepseek-v4

LangChain integration package for DeepSeek chat models

langchain-digitalocean

An integration package connecting Digitalocean and LangChain

langchain-doubleword

An integration package connecting Doubleword and LangChain / LangGraph.

langchain-fastapi-chat-completion

A bridge to use Langchain output as an OpenAI chat completion API.

langchain-featherless-ai

An integration package connecting FeatherlessAi and LangChain

langchain-ferrolabsai

LangChain integration for Ferro Labs AI Gateway — chat, streaming, embeddings, and tool calling across 30 LLM providers via a single OpenAI-compatible endpoint

langchain-fireworks

An integration package connecting Fireworks and LangChain

langchain-freelanceflow

LangChain integration for FreelanceFlow - Smart AI model routing across 21+ models with cost tracking

langchain-fused-model

Intelligent routing and management for multiple LangChain ChatModel instances with rate limiting, fallback, and structured output support

langchain-g4f

LangChain gpt4free is an open-source project that assists in building applications using LLM (Large Language Models) and provides free access to GPT4/3.5.

langchain-g4f-chat

LangChain integration for g4f

langchain-ibm

An integration package connecting IBM watsonx.ai and LangChain

langchain-ibm-watson

An integration package connecting IBM Watson and LangChain

langchain-ibm-watsonxai

An integration package connecting IBM watsonx.ai and LangChain

langchain-igpt

Integration package connecting iGPT and LangChain

langchain-iointelligence

LangChain integration for io Intelligence LLM API with OpenAI compatibility

langchain-kalibr

The first autonomous routing system for AI agents. Routes to the optimal execution path to prevent failures, degradations, and cost spikes before they impact users.

langchain-litellm

An integration package connecting LiteLLM and LangChain

langchain-llm

langchain llm wrapper

langchain-llm-api

Wrappers around LLM API models and embeddings clients.

langchain-llm-config

A comprehensive LLM configuration package supporting multiple providers (OpenAI, VLLM, Gemini, Infinity) for chat assistants and embeddings

langchain-llm7

A LangChain wrapper for LLM7 API

langchain-nebius

LangChain integration for Nebius AI Studio

langchain-netmind

An integration package connecting Netmind and LangChain

langchain-nexus

Langchain-Nexus is a Python library enabling easy integration with diverse language models like ChatGPT and GLM through a unified interface.

langchain-nvidia-ai-endpoints

An integration package connecting NVIDIA AI Endpoints and LangChain

langchain-nvidia-aiplay

This package is deprecated. Please use langchain-nvidia-ai-endpoints instead.

langchain-oci

An integration package connecting OCI and LangChain

langchain-openai

An integration package connecting OpenAI and LangChain

langchain-openai-aipy

An integration package connecting OpenAI and LangChain

langchain-openai-api-bridge

A bridge to use Langchain output as an OpenAI-compatible API.

langchain-openai-limiter

Wrapper for Langchain & OpenAI api calls which use OpenAI headers to deal with TPM & RPM.

langchain-openai-thinking-agui

LangChain chat model wrappers that expose reasoning/thinking content in ag-ui-langgraph compatible format

langchain-openrouter

An integration package connecting OpenRouter and LangChain

langchain-openrouter-chat
langchain-opperai

An integration package connecting OpperAI and LangChain

langchain-pipeshift

An integration package connecting Pipeshift and LangChain

langchain-pollinations

LangChain provider for Pollinations unified API (OpenAI-compatible chat completions + image endpoint).

langchain-predictionguard

[DEPRECATED] Prediction Guard LangChain integration. No longer maintained; use langchain-openai or langchain-anthropic instead.

langchain-router

Cost-aware model routing for LangChain agents based on task phase

langchain-seahorse

LangChain VectorStore integration for Seahorse API Gateway

langchain-seekrflow

LangChain integration for SeekrFlow chat models

langchain-siliconflow

An integration package connecting SiliconFlow and LangChain

langchain-spark

LangChain interface for iFLYTEK Spark

langchain-sparkai
langchain-together

An integration package connecting Together AI and LangChain

langchain-verathos

LangChain integration for Verathos — verified LLM inference on Bittensor

langchain-volcengine
langchain-volcengine-python
langchain-volcengine-python-sdk
langchain-wenxin
langchain-winwin
langchain-xai

An integration package connecting xAI and LangChain

langchain-xfyun

在LangChain中流畅地使用讯飞星火大模型

langchain-zhipuai

LangChain interface for Zhipu AI

langchain-zhipuai-dev

Implementation of LangChain for ZhipuAI(Just for coding exercise)

langchain-zunno

LangChain integration for Zunno LLM and Embeddings

langchain_dashscope

将阿里云灵积模型(通义千问等)集成到LangChain

langchain_zhipu

将智谱AI集成到LangChain

langchainbridge

A unified wrapper for various LLM providers using LangChain.

langchainforhcx

langchain for hyperclovax written by xeexu

langcore-hybrid-llm-regex

LangCore hybrid provider — combines deterministic rule/regex extraction with LLM fallback for cost savings

langcore-litellm

LangCore provider plugin for LiteLLM

langextract-anthropic

LangExtract provider plugin for Anthropic Claude

langextract-azureopenai

LangExtract provider plugin for Azure OpenAI

langextract-bedrock

LangExtract provider plugin for AWS Bedrock

langextract-claude

Anthropic Claude provider plugin for LangExtract

langextract-litellm

LangExtract provider plugin for LiteLLM

langextract-openai

OpenAI and Azure OpenAI provider plugin for LangExtract

langgraph-responses-gateway

Expose any LangGraph agent as an OpenAI Responses API endpoint

langgraph_openai_serve

Openai Compatible Langgraph Server

launchdarkly-server-sdk-ai-bedrock

LaunchDarkly AI SDK Bedrock Provider (placeholder — full release coming soon)

More in Agent frameworks & infrastructure