Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 23 of 41

dazllm

Simple, unified interface for all major LLMs

db-claude-bridge

A lightweight bridge that lets the Claude Code CLI authenticate and run through Databricks Foundation Models using Databricks OAuth.

definable-llms

Scalable multi-provider LLM library with unified interface for OpenAI, Gemini, Anthropic, Deepseek, Moonshot and xAI

delos-llmax

Interface to handle multiple LLMs and AI tools.

developeralex-openai-without-pydantic

A simple Python wrapper for OpenAI API without Pydantic dependencies

divyam-llm-interop

A lightweight, provider-neutral library for translating LLM requests and responses across model APIs.

dj-llm

A beautiful unified LLM interface for Django with persistence and streaming

docketeer-anthropic

Anthropic inference backend plugin for Docketeer

donkit-llm

Unified LLM model implementations for Donkit (OpenAI, Azure OpenAI, Claude, Vertex AI, Ollama)

dph-openai-completion-base

Base building blocks for DP OpenAI completion flows (callbacks, API base, DB connector).

dr-llm

Provider-agnostic single-query LLM client with PostgreSQL recording and catalog storage.

dragoman-ai

A small CLI that lets Claude Code reach non-Anthropic models — Ollama, Perplexity, OpenAI, Gemini — through a subagent that knows how to call it.

dsapi-llmclient

轻量级LLM API客户端库,支持缓存、重试和详细日志记录功能

dspy-codex-auth

DSPy integration for ChatGPT Codex subscription-backed language models

dspy-coding-agent-lms

DSPy LM integration for Claude Code CLI - route DSPy requests through local Claude Code agent

dspy-lm-auth

Pi-style LM authentication helpers for DSPy

duckgpt

A Python client for DuckGPT

dynamic-agent-switcher

A flexible package for switching AI models during agent execution

easier-openai

Utilities for orchestrating OpenAI chat, tool calling, search, audio, and images from one helper package.

easy-gpt-utils

Easy GPT utils include 1. chat completion 2. embedding and 3. vector database

easy-llms

Easy '1-line' calling of every LLM from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

easyllm

Description

easyllm-kewu93

An easier way to query LLMs

ecate-llm

Intelligent multi-model LLM router with auto-calibration and multilingual support

edgequake-litellm

Drop-in LiteLLM replacement backed by Rust — same API, 10× lower latency

eenhoorntje-llm-lib

A lib for cached LLM calling and translation

efficient-agent-router-ear

Efficient Agent Router — routes tasks to the best LLM under quality, latency, cost, and safety constraints

ehs-llm-client

Async client for OpenAI, Azure OpenAI, Microsoft Foundry, Google Gemini and TypeSafe decision models

eidolon-ai-mistralai
einhoorntje-llm-lib

A lib for cached LLM calling and translation

elasticsearch-llm-cache

A caching utility for Elasticsearch leveraging vector search

elizaos-plugin-anthropic

elizaOS Anthropic Plugin - Claude API client for text and object generation

elizaos-plugin-groq

Groq LLM plugin for elizaOS - Python implementation for fast inference

elizaos-plugin-openai

elizaOS OpenAI Plugin - OpenAI API integration for text, image, audio, and embeddings

ellm
enthusiast-model-azureopenai

A plugin for Enthusiast that provides an OpenAI connector.

enthusiast-model-mistral

A plugin for Enthusiast that provides an Mistral connector.

enthusiast-model-openai

A plugin for Enthusiast that provides an OpenAI connector.

epic-llm

Orchestration tool for managing third-party LLM API providers

evalops-anthropic

Drop-in Anthropic SDK shim for EvalOps llm-gateway routing

evalops-openai

Drop-in OpenAI SDK shim for EvalOps llm-gateway routing

evolution-openai

Evolution OpenAI with automatic token management

exoclaw-provider-litellm

LiteLLM provider for exoclaw

exoclaw-provider-openai

OpenAI-compatible LLM provider for exoclaw with streaming request bodies, per-model routing, and CPython + MicroPython support

exocortex-llm-router

Provider-agnostic LLM call_tool router with yaml routing, fallback chains, and cost telemetry.

expert-llm

LLM client for 'expert'

ext-llm

A wrapper library to abstract common llm providers

ez-openai

A more reasonable OpenAI API.

fake-llm-server
fakeopenai

A Fake OpenAI API based on pandora

fast-litellm

High-performance Rust acceleration for LiteLLM

fast-openai
fastapi-llm

FastAPI for Large Language Models

fastapi-llm-gateway

A composable FastAPI LLM gateway with unified multi-provider support

fastapi-openai
fastapi-openai-compat

FastAPI router factory for OpenAI-compatible Chat Completions, Responses, and Files endpoints

fastinference-llm

Seamlessly integrate with top LLM APIs for speedy, robust, and scalable querying. Ideal for developers needing quick, reliable AI-powered responses.

fastllm

Fast and easy wrapper around LLMs.

fastllm-kit

High-performance parallel LLM API request tool with caching and multiple provider support

fetchcraft-openai-server

OpenAI-based server for Fetchcraft

flexllm

High-performance LLM client with batch processing, caching, and checkpoint recovery

fllm-cli

FoundationaLLM Command-Line Tools

fllm-cli-core

FLLM Command-Line Tools Core Module

flow-llm-router

Local-first LLM gateway with token usage analytics for AI developers

fluxllm

A blazing-fast gateway for asynchronous, high-concurrency LLM requests (OpenAI, Claude, etc.).

flyflow-openai

The official Python library for the flyflow API

flying-delta-llms-anthropic

llama-index llms anthropic integration

flying-delta-llms-anyscale

llama-index llms anyscale integration

flying-delta-llms-azure-openai

llama-index llms azure openai integration

flying-delta-llms-gemini

llama-index llms gemini integration

flying-delta-llms-gradient

llama-index llms gradient integration

flying-delta-llms-huggingface

llama-index llms huggingface integration

flying-delta-llms-openai

llama-index llms openai integration

flying-delta-llms-openai-like

llama-index llms openai like integration

flying-delta-llms-replicate

llama-index llms replicate integration

flying-delta-program-openai

llama-index program openai integration

flytekitplugins-chatgpt

This package holds the ChatGPT plugins for flytekit

flytekitplugins-openai

This package holds the openai plugins for flytekit

flyteplugins-anthropic

Anthropic Claude plugin for flyte

flyteplugins-gemini

Google Gemini plugin for flyte

flyteplugins-openai

OpenAI plugin for flyte

fmus-zllm

A simple, unified interface for multiple LLM providers

fredRevChatGPT

ChatGPT is a reverse engineering of OpenAI's ChatGPT API

free-apis-llm-cascade

Free API-based LLM Cascading

free-gpt.py

Library for use free gpt 3.5 in python

free-llm-toolbox

A Python toolbox for easy interaction with various LLMs and Vision models

free-llms

Use LLMs for Free.

free-pygpt

Library for use free gpt 3.5 in python

freeGPTFix

freeGPT provides free access to text and image generation models.

freechatgpt

free chatgpt api, not need token

freeflow-llm

Chain multiple free-tier LLM APIs with automatic rate limit fallback

freegpt

Library for interacting with multiple AI APIs

freegpthub

FreeGPTHub: A truly free, unified GPT API gateway—unlike “fake-free” alternatives that hide paywalls behind quotas, trials, or mandatory top-ups.

freegpts

The project provides free access to ChatGPT-4, GPT-4o-mini, and SearchGPT models for integration into Python applications.

freellm

The simplest Python client for free access to top-tier AI models (GPT-4.1 Nano, DeepSeek, Gemini Flash, Claude Haiku)

gemgroq

A unified API interface for Groq and Google's Gemini AI models

gemini-2.0-api

A user-friendly wrapper for the Google Gemini 2.0 API

gemini-ai

A Python package for the Gemini AI generative model

gemini-api-toolkit

A robust, lightweight Python wrapper for the Google Gemini API.

gemini-assistant

A helper library for integrating the Google Gemini API into web applications.

More in Agent frameworks & infrastructure