CLI utility and Python library for interacting with Large Language Models from organizations like OpenAI, Anthropic and Gemini plus local models installed on your own machine.

llm-1min

LLM access to models served by 1minAI

llm-1minai

LLM plugin providing access to 75+ AI models through 1min.ai API v2 (chat-with-ai endpoint) with SSE streaming, attachments, AI memory, brand voice, web search, and persistent options

llm-accounting

A package for tracking LLM usage and costs

llm-actor

LLM actor: pool, circuit breaker, retries, metrics

llm-acuration

An LLM package made by Acuration

llm-adapter-gen-ai-proj

Generic abstraction layer for GenAI services

llm-adapters

Adapters as API gateways to Different LLM Models

llm-adaptive-router

An adaptive router for LLM model selection

llm-ads

FastAPI middleware for LLM ad serving integration

llm-agent

Multi-Agent Language Game Environments for Large Language Models

llm-agent-bench

Benchmark autonomous AI agents on task completion, tool use, goal adherence, and safety. Works with any agent — just provide a callable.

llm-agent-graph

A short description of your library

llm-agent-plugin

plugin for simonw's llm to add a langchain agent

llm-agent-protector

Polymorphic Prompt Assembler to protect LLM agents from prompt injection and prompt leak

llm-agent-scaffolder

A scaffolding tool to quickly generate a boilerplate for a custom LLM Agent Framework.

llm-agent-toolkit

LLM Agent Toolkit provides minimal, modular interfaces for core components in LLM-based applications.

llm-agentguard

Detect silent failures in LLM agents

llm-agents

llm_agents

llm-agents-from-scratch

Build an LLM agent, equipped with MCP, from scratch.

llm-agentspec

pytest-style behavioral contracts for LLM agent tool-call sequences

llm-agenttree

Tree-structured multi-agent runtime with a FastAPI core, LangChain agents, and event-driven executors.

llm-aggregator

A model aggregator service for multiple LLM backends.

llm-agregator

A package for generating diagrams using various models

llm-alias-options

LLM plugin to save prompt options alongside an alias

llm-alignment

A small example package

llm-all-models-async

Make all LLM sync models available as async

llm-analysis

Latency and Memory Analysis of Transformer Models for Training and Inference

llm-analysis-assistant

An LLM analysis assistant to help you understand and implement PMF

llm-annotator

An easy-to-extend LLM annotator for robust, resumable data annotation.

llm-anon

CLI tool to anonymize code using local LLM before sending to Claude Code

llm-anthropic

LLM access to models by Anthropic, including the Claude series

llm-antibodies

Antibodies for LLM hallucinations

llm-anygate

A flexible gateway for connecting and managing multiple LLM providers

llm-anyscale-endpoints

LLM plugin for models hosted by Anyscale Endpoints

llm-api-access

Unified interface to query popular LLM providers via PyO3

llm-api-adapter

Lightweight multi-provider LLM API adapter for Python — OpenAI, Anthropic, Google, and Mistral.

llm-api-benchmark-mcp-server

Runs a throughput benchmark for LLM APIs, measuring generation throughput, prompt throughput, and Time To First Token (TTFT) under various concurrency levels.

llm-api-bridge

A unified interface for querying multiple LLM providers via REST APIs

llm-api-client

A client for interacting with LLM completion APIs and tracking usage.

llm-api-engine

Unified LLM API provider and engine library

llm-api-multiple

The official Python library for the llm_api API

llm-api-open

Unofficial open APIs for popular LLMs with self-hosted redirect capability

llm-api-python

A python lib to call LLM API models.

llm-api-router

A unified API routing library for Large Language Models

llm-api-scope

read and cache structured documents from remote for LLM agents

llm-api-server

LLM plugin to expose a FastAPI server with compatible APIs for popular LLM clients

llm-apigateway

Debug your AI programs with ease through a web-based interface. Modify inputs and outputs, and leverage the power of custom Python filters.

llm-apm

LLM Application Performance Monitoring - Real-time monitoring for LLM-powered applications

llm-app

LLM-App is a library for creating responsive AI applications leveraging OpenAI/Hugging Face APIs to provide responses to user queries based on live data sources. Build your own LLM application in 30 lines of code, no vector database required.

llm-apple

LLM plugin for Apple Foundation Models (Apple Intelligence)

llm-arbiter

A/B testing for LLMs. Statistical proof, not vibes.

llm-arxiv

LLM plugin for loading arXiv papers

llm-as-dom

AI browser pilot — test your app 60x cheaper. MCP server binary wrapper.

llm-as-dom-mcp

AI browser pilot — test your app 60x cheaper. MCP server binary wrapper.

llm-as-function

Embed your LLM into a python function