Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 26 of 41

launchdarkly-server-sdk-ai-openai

LaunchDarkly AI SDK OpenAI Provider

lazyopenai
leanllm-ai

Lightweight LLM wrapper with usage tracking and label support

lessllm

A lightweight LLM API proxy framework with network connectivity and usage analysis

libagent-ai

A simple LLM client wrapper for OpenAI-compatible APIs

libgpt

A module for using GPT-3/4 for free (Needs Chrome or Chromium browser for GPT-3)

linkgrid-agent

LinkGrid Agent - Python client for BitNet API

linkllm

The unified LLM runtime — local inference, API proxy, and monitoring. A powerful alternative to Ollama + LiteLLM, built in Rust.

lion-anthropic

Add your description here

lion-groq

Add your description here

lion-openai

lion openai service integration

lite-llm-client

A small example package

litelitellm

Lightweight Anthropic Messages API proxy with LiteLLM-style config — load your middleware from any project

litellm

Library to easily interface with LLM API providers

litellm-apple-foundation-models

LiteLLM custom provider for Apple's on-device Foundation Models

litellm-detector

Filesystem-only LiteLLM package detector with terminal UX and advisory checks.

litellm-dev

Library to easily interface with LLM API providers

litellm-enterprise

Package for LiteLLM Enterprise features

litellm-gigachat

Полнофункциональная интеграция GigaChat API с LiteLLM

litellm-ibm-bob

LiteLLM custom provider for IBM Bob (bobshell) backend

litellm-kamiwaza

LiteLLM Router integration for Kamiwaza AI

litellm-plus

Library to easily interface with LLM API providers

litellm-proxy-extras

Additional files for the LiteLLM Proxy. Reduces the size of the main litellm package.

litellm-retry-wrapper

A robust wrapper for LiteLLM with retry logic and rate limiting

litellm-slipstream-fork

Library to easily interface with LLM API providers

litellm-td-llm-provider

LiteLLM provider for Treasure Data LLM Proxy

litellm-types
litellm-util

CLI tool for managing LiteLLM Proxy Server

litellm-utils

Lightweight Python wrapper for LiteLLM with simplified interface for 100+ AI providers. Supports text, images, and documents with conversation management.

litellm-verathos

LiteLLM custom provider for Verathos -- verified LLM inference on Bittensor

litellm_ad

Library to easily interface with LLM API providers

liter-llm

Universal LLM API client with Rust-powered polyglot bindings.

livellm

Python client for the LiveLLM Server

llama-api-client

The official Python library for the llama-api-client API

llama-index-extra-llm

Just a simple extension for LlamaIndex for better apply some llm such as DeepSeek.

llama-index-llms-ai21

llama-index llms ai21 integration

llama-index-llms-aibadgr

llama-index llms aibadgr integration

llama-index-llms-alephalpha

llama-index llms Aleph Alpha integration

llama-index-llms-alibabacloud-aisearch

llama-index llms alibabacloud_aisearch integration

llama-index-llms-anthropic

llama-index llms anthropic integration

llama-index-llms-anyscale

llama-index llms anyscale integration

llama-index-llms-apertis

llama-index llms Apertis integration

llama-index-llms-asi

llama-index llms asi integration

llama-index-llms-asimov

llama-index llms ASIMOV integration

llama-index-llms-azure-inference

Integration for model supporting Azure AI model inference API in llama-index

llama-index-llms-azure-openai

llama-index llms azure openai integration

llama-index-llms-baseten

llama-index llms baseten integration

llama-index-llms-bedrock

llama-index llms bedrock integration

llama-index-llms-bedrock-converse

llama-index llms bedrock converse integration

llama-index-llms-cerebras

llama-index llms cerebras integration

llama-index-llms-clarifai

llama-index llms clarifai integration

llama-index-llms-cleanlab

llama-index llms cleanlab integration

llama-index-llms-cloudflare-ai-gateway

llama-index llms cloudflare ai gateway integration

llama-index-llms-cohere

llama-index llms cohere integration

llama-index-llms-cometapi

llama-index llms cometapi integration

llama-index-llms-contextual

llama-index contextual integration

llama-index-llms-cortex

llama-index llms cortex integration

llama-index-llms-dashscope

llama-index llms dashscope integration

llama-index-llms-databricks

llama-index llms databricks integration

llama-index-llms-deepinfra

llama-index llms deepinfra integration

llama-index-llms-deepseek

llama-index llms deepseek integration

llama-index-llms-digitalocean-gradientai

LlamaIndex integration for DigitalOcean Gradient AI

llama-index-llms-everlyai

llama-index llms everlyai integration

llama-index-llms-featherlessai

llama-index llms featherlessai integration

llama-index-llms-ferrolabsai

LlamaIndex LLM integration for Ferro Labs AI Gateway — route LlamaIndex workloads across 30+ LLM providers via a single OpenAI-compatible endpoint

llama-index-llms-fireworks

llama-index llms fireworks integration

llama-index-llms-friendli

llama-index llms friendli integration

llama-index-llms-gaudi

llama-index llms gaudi integration

llama-index-llms-gemini

llama-index llms gemini integration

llama-index-llms-gigachat

Project by kotko

llama-index-llms-gigachat-ru

llama-index llms gigachat integration

llama-index-llms-google-genai

llama-index llms google genai integration

llama-index-llms-gradient

llama-index llms gradient integration

llama-index-llms-grok

LlamaIndex integration for xAI Grok models with full structured output support, token counting, and native xai-sdk integration

llama-index-llms-groq

llama-index llms groq integration

llama-index-llms-helicone

llama-index llms helicone (OpenAI-compatible) integration

llama-index-llms-keywordsai

llama-index llms keywordsai integration

llama-index-llms-litellm

llama-index llms litellm integration

llama-index-llms-openai-like

llama-index llms openai like integration

llama-index-llms-openrouter

llama-index llms openrouter integration

llama-index-llms-ovhcloud

llama-index llms ovhcloud integration

llama-index-llms-paieas

llama-index llms aliyun paieas integration

llama-index-llms-palm

llama-index llms palm integration

llama-index-llms-perplexity

llama-index llms perplexity integration

llama-index-llms-pipeshift

llama-index llms pipeshift integration

llama-index-llms-portkey

llama-index llms portkey integration

llama-index-llms-predibase

llama-index llms predibase integration

llama-index-llms-premai

llama-index llms Prem AI integration

llama-index-llms-qianfan

llama-index llms baidu qianfan integration

llama-index-llms-reka

llama-index llms reka integration

llama-index-llms-replicate

llama-index llms replicate integration

llama-index-llms-rungpt

llama-index llms rungpt integration

llama-index-llms-sambanova

Project by kotko

llama-index-llms-sambanovacloud

llama-index llms sambanova cloud integration

llama-index-llms-sambanovasystems

llama-index llms sambanova cloud and sambastudio integration

llama-index-llms-sarvam

llama-index llms sarvam integration

llama-index-llms-servam

llama-index llms servam integration

llama-index-llms-siliconflow

llama-index llms siliconflow integration

llama-index-llms-solar

llama-index llms solar integration

llama-index-llms-stepfun

llama-index llms stepfun integration

More in Agent frameworks & infrastructure