Agent frameworks & infrastructure
LLM gateways & API proxies
4,018 agents · most starred first
LLM gateways & API proxies, page 27 of 41
llama-index llms together integration
llama-index llms unify integration
A custom LlamaIndex Llms integration for UnionLLM
llama-index llms upstage integration
llama-index llms vercel ai gateway integration
llama-index llms vertex integration
llama-index llms watsonx integration
llama-index llms yi integration
llama-index LLM integration with You.com's conversational Smart and Research APIs
llama-index llms zhipuai integration
llama-index selectors Not Diamond integration
Unified interface for multiple LLM providers with advanced features (routing, privacy, logging).
Proxy service for the LlamaAI ecosystem.
Lightweight OpenAI API server on top of Llama local models. Suitable for combined use with Microsoft AutoGen.
Llama API Python Client
Llama API python SDK
A flexible API client and server utilities package
One master key for all LLM/GenAI endpoints
CLI client for LlamaPass - Ollama gateway with authentication and token tracking
CLI utility and Python library for interacting with Large Language Models from organizations like OpenAI, Anthropic and Gemini plus local models installed on your own machine.
LLM access to models served by 1minAI
LLM plugin providing access to 30 curated frontier AI models through the 1min.ai API (chat-with-ai endpoint) with SSE streaming, attachments, AI memory, brand voice, web search, and persistent options
An LLM package made by Acuration
Generic abstraction layer for GenAI services
Adapters as API gateways to Different LLM Models
An adaptive router for LLM model selection
FastAPI middleware for LLM ad serving integration
A model aggregator service for multiple LLM backends.
A package for generating diagrams using various models
Make all LLM sync models available as async
LLM access to models by Anthropic, including the Claude series
A flexible gateway for connecting and managing multiple LLM providers
LLM plugin for models hosted by Anyscale Endpoints
Unified interface to query popular LLM providers via PyO3
Lightweight multi-provider LLM API adapter for Python — OpenAI, Anthropic, Google, Mistral, xAI, Qwen, Kimi, DeepSeek, and Z.ai.
A unified interface for querying multiple LLM providers via REST APIs
A client for interacting with LLM completion APIs and tracking usage.
Unified LLM API provider and engine library
The official Python library for the llm_api API
Unofficial open APIs for popular LLMs with self-hosted redirect capability
A python lib to call LLM API models.
A unified API routing library for Large Language Models
LLM plugin to expose a FastAPI server with compatible APIs for popular LLM clients
Multi-LLM Provider Library
Azure AI Foundry plugin for LLM - access Anthropic, Llama, Mistral and more via Azure
Add your description here
LLM plugin to access model deployments on Azure AI Foundry and Foundry Local
LLM plugin to access Azure OpenAI models
LLM Base
Run prompts against models hosted on AWS Bedrock
LLM plugin for Amazon Titan on AWS Bedrock
LLM plugin for Anthropic's Claude on AWS Bedrock
LLM plugin for AWS Bedrock Converse API with tool calling and embeddings support
LLM plugin for Meta Llama2 on AWS Bedrock
LLM plugin for Mistral on AWS Bedrock
LLM plugin for Amazon's Nova on AWS Bedrock
Unified Python library for LLM APIs (OpenAI, Anthropic, Gemini, xAI, Groq, custom)
Semantic cache, multi-provider LLM router and cost tracker (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen)
Cache LLM API calls to speed up development and prevent rate limits
Unified Language Model Cache.
Simple Azure OpenAI call helper
llm api and prompt
Plugin for LLM adding fast Cerebras inference API support
chat api collection for popular LLM
LLM plugin for models hosted by Chutes AI
LLM plugin for Anthropic's Claude
llm-claude-3 is now llm-anthropic
llm plugin for multi-LLM orchestration via llm-cli-gateway
Universal AI CLI Proxy, Firewall, and Token Intelligence Gateway
LLM redis中介的客户端程序
An LLM CLI plugin for Cloudflare Workers AI models.
Plugin for LLM adding support for Cohere's Generate and Summarize models
Access the Cohere Command R family of models
A Python wrapper for managing OpenAI API and other LLM models.
A library for LLM text completion using LiteLLM
A provider-agnostic SDK for LLM, image, video, and embedding model clients
LLM Connect API
A unified Python connector for multiple LLM providers with YAML-driven configuration.
A library of connectors for popular AI platforms
Unified async cookie/session bridge for major AI web apps.
Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.
Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.
Access deepseek.com models via API
LLM access to DeepSeek's API
Yet another LLM access to DeepSeek's API
A minimal, auditable Python library for calling multiple LLM providers. Lightweight LiteLLM alternative.
LLM plugin for models hosted by DigitalOcean AI
LLM model discovery and tracking system for real-time monitoring of available models across multiple providers
Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics
LLM plugin for Duckduckgo AI Chat service
LLM plugin for models hosted by ElectronHub
A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
Create ensembles of Large Language Models to query them all at the same time.
This package is a utility library for interfacing with multiple Large Language Models (LLMs) using a common interface.
Een package om LLM modellen te initialiseren op basis van provider.
A toolkit for interacting with various Large Language Models
Multi-LLM provider client with automatic failover and priority ordering
Automatic failover between LLM providers. When OpenAI is down, seamlessly switch to Anthropic, Google, or any backup.
A comprehensive Python library for managing fallback mechanisms for Large Language Model (LLM) API calls using LiteLLM