Agent frameworks & infrastructure

LLM gateways & API proxies

4,018 agents · most starred first

LLM gateways & API proxies, page 24 of 41

gemini-batch-api

Gemini Batch API utility

gemini-batch-processor

A Python module to process bulk data using Google's generative AI (Gemini).

gemini-botyy

A helper library for AI text generation using Google Gemini API.

gemini-calo

A Fastapi Based Proxy for Gemini API

gemini-cli-proxy

OpenAI-compatible API wrapper for Gemini CLI

gemini-firefox-api

Unofficial Gemini API with Firefox cookie auto-retrieval and easy chat client.

gemini-flux

Smart Gemini API key manager with token-aware sliding window scheduling

gemini-llm

Global CMD Gemini LLM

gemini-model-rotater

A package to rotate Gemini API models based on rate limits.

gemini-ng

Next-generation Gemini API Client

gemini-parallel

Simplified Sequential Processor for Google Gemini API

gemini-parallel-mongodb

Parallel Gemini API calls with MongoDB logging support

gemini-public-api

⚠️ This package is no longer maintained. No future updates will be released.

gemini-python

A python client for the Gemini API and Websocket

gemini-python-api

Modules for working with Gemini's API in a pythonic way

gemini-re

Gemini API reimplementation

gemini-rotate

A lightweight Python library for Google Gemini API key rotation and model fallback.

gemini-rotator

Key rotator, don't get dizzy.

geminipy

API client for Gemini

geminiwrapper

Library for generating consistent Gemini API outputs and wrapping them with json and python objects

genai-gateway-langchain

x

genblaze-openai

OpenAI provider adapters for genblaze (Sora, DALL-E, TTS)

generic-llm-api-client

A unified, provider-agnostic Python client for multiple LLM APIs

genie-flow-invoker-ollama

Genie Flow Invoker Ollama

genie-flow-invoker-openai

Genie Flow Invoker OpenAI on Azure

genkit-plugin-anthropic

Deprecated: This package has been renamed to genkit-anthropic.

giskard-llm

Lightweight LLM routing layer over native provider SDKs

glueco-plugin-llm

LLM plugin for Glueco Gateway SDK - Typed chat completions for OpenAI, Groq, Gemini

go-chatgpt

Quick call to openai chatgpt api web page

gogo-gemini

A package for interacting with the Gemini model

goliath-llm-client

A Python client library for the Goliath LLM API

gonka-openai

OpenAI client with Gonka network integration

gpt-address-api

Decentralized GPT API for everyone !

gpt-api-python

Python client sdk to access GPT's AI-powered conversational functionality (without OpenAI API key nor VPN)

gpt-batch

A package for batch processing with OpenAI API.

gpt-batch-api

Efficiently and robustly use the OpenAI Batch API in Python

gpt-batch-manager

Tools for splitting jobs across multiple OpenAI batches

gpt-client-lite

Minimal OpenAI GPT client for Python - chat, embeddings, functions, streaming, no heavy deps

gpt-gateway

Client for GPT-Gateway.com including ChatGPT Retreiver Plugins

gpt-prive

Tools for setup/communications to a LLM models

gpt-trim

Trims the messages array for ChatGPT API

gpt2Api-Client

Wrapper for the GPT2 Api

gpt2giga

Утилита для проксирования OpenAI, Anthropic и Gemini запросов в GigaChat

gpt3

Wrapper for GPT3 API

gpt3-api

Module for working with GPT-3 API by Roughs Team

gpt3-prompt-to-text

A trivial command line tool to invoke OpenAI's completion API

gpt4-api

gpt4 api engine

gpt4-copilot-free-api

Default template for PDM package

gpt4-openai-api

Python package for unofficial GPT-4 API access via chat.openai.com using Chrome browser via Selenium

gpt4free

The official gpt4free repository | various collection of powerful language models

gpti

This package simplifies your interaction with various GPT models, removing the need for tokens or other methods to access GPT

gptmock

OpenAI & Ollama compatible API powered by your ChatGPT account

gptx-py

A python based wrapper for GPT-4 & GPT-3.5 PLUS.

gracefox-llm-hub

统一的LLM调用库,支持多种LLM提供商、文件上传、环境感知

grazie-llm
greenllm

Add your description here

greenllm-sdk

Add your description here

groq

The official Python library for the groq API

groq-rotator

Drop-in async Groq client with automatic API key rotation on rate limits

groqa

A Python client for the GROQA API

groqcloud

The official Python library for the groq API

groqon

Use Groq.com as llm

groqpy

A Python package.

gspringer-litellm

Library to easily interface with LLM API providers

guarded-llm

Strict JSON LLM outputs with multi-provider support (Anthropic / OpenAI / DeepSeek / Kimi / Google)

hanzo-llm

Library to easily interface with LLM API providers

heroku-langchain-aisdk

A Python SDK for Heroku's Managed Inference API (MIA), providing easy access to AI models through a LangChain-compatible interface.

hibiz-any-llm

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

hibiz-llm-wrapper

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

hiway2llm

HiWay2LLM SDK (Python) — OpenAI-compatible client for the HiWay router. BYOK, 40-60% savings, 0% markup on inference.

hopeit-agents.model-client

Hopeit Agents: LLM models client

hyperllm

A unified interface for multiple LLM providers with caching and interactive development mode to get massive cost savings.

hypnex-openai

Drop-in OpenAI client for the Morpheus decentralized inference network (mor.org)

iflow-mcp_vmlinuzx-llmc

LLM cost compression through intelligent RAG and multi-tier routing

igptai

Official Python SDK for the iGPT API

iil-bfagent-llm

LLM integration for BFAgent Hub ecosystem — DB-driven routing, LiteLLM backend, resilient adapters (ADR-089)

im-agent-gate
infinity-llm

use any llm api in a plug-and-play fashion

init-llm

A toolkit for initializing LLMs and embeddings with multiple providers

input-llm

Intercept OpenAI inputs

inscodegpt

Inscode GPT API python package

isagellm-gateway

sageLLM Gateway - OpenAI/Anthropic compatible API Gateway (L6)

jcloudai-litellm

LiteLLM integration for PandasAI

jentic-apitools-llm

Jentic Apitools LLM - Unified LLM utilities and provider abstraction for consistent LLM usage across packages

jsonLiteLLM
jsonllm-client

Client for JsonLLM API

jupyter-ai-chatgpt

Jupyter AI module that provides a ChatGPT model engine.

jupyter-ai-litellm

A JupyterLab extension that provides LiteLLM model abstraction

justllms

Production-focused Python library for multi-provider LLM management with unified API

k-llms

Retab official python library

kaar-gpt

OpenAI API wrapper

kantan-llm

Minimal LLM client getter for OpenAI Responses + OpenAI-compatible Chat Completions.

kaos-llm-client

Thin, provider-native LLM client for direct model calls within the KAOS ecosystem

kctl-litellm

Kodemeio LiteLLM CLI — manage LiteLLM proxy instances

keel-llm-adapter-anthropic

Reference keel-llm-protocol adapter for Anthropic's Messages API — the divergent-provider grounding for the standard.

keel-llm-adapter-bedrock

Reference keel-llm-protocol adapter for AWS Bedrock — enterprise gateway. Use Claude / Llama / Titan / Mistral / Cohere models hosted on Bedrock with the Keel vendor-neutral protocol + reliability + OTel stack.

keel-llm-adapter-google

Reference keel-llm-protocol adapter for Google's native Gemini generateContent API.

keel-llm-adapter-openai

Reference keel-llm-protocol adapter for any OpenAI-compatible chat endpoint (OpenAI, Groq, OpenRouter, Mistral, vLLM, Ollama, ...).

keel-llm-reliability

Composed reliability for multi-model LLM calls — quorum fan-out + primary/failover, category-dispatched, transparent degradation. Built on keel-llm-protocol + keel-circuit-breaker.

kestrel-llm-bedrock

AWS Bedrock LLM provider plugin for Kestrel Sovereign.

More in Agent frameworks & infrastructure