PyPI agents

LLM plugin providing access to models running on an Ollama server

OneSDK is a Python library that provides a unified interface for interacting with various Large Language Model (LLM) providers.

Conditionally serve content to LLM crawlers in Python web frameworks.

Access OpenAI models via a Codex subscription

LLM plugin for OpenAI and Google image generation and editing

LLM plugin for OpenAI

Access OpenAI models via a Codex subscription

LLM plugin to access OpenHands Cloud API

LLM plugin for models hosted by OpenRouter

Add your description here

A placeholder package for llm-oracle

Multi-agent LLM communication system with ensemble orchestration

An open-source chatgpt tool ecosystem where you can combine tools with chatgpt and use natural language to do anything.

Drop-in OpenTelemetry GenAI observability for any LLM backend — local or cloud.

Validate LLM outputs against schemas with automatic retry and JSON extraction.

Extract and parse JSON from unstructured text outputs from LLMs

Sanitize LLM outputs before HTML, SQL, shell, or markdown sinks. Python port of @mukundakatta/llm-output-sanitizer.

Plugin for LLM adding support for Google's PaLM 2 model

A library to parametrize multiple API calls for LLMs

Multi-agent debate for better AI decisions. Research-backed, local-first.

Parse data from documents optimised for downstream llm tasks.

A simple JSON parsing tool that preprocesses and parses JSON strings.

Microlib for partial deployment of LLMs

Real-time chat between multiple LLMs with human moderator ability

LLM Patch Driver is a framework for patching data objects using LLMs. It can generate and apply a single patch, or start the patching loop to fix complex validation issues.

Robust search/replace file editing for LLM-driven code changes

A tool for tracing LLM requests

Transform enrichment outputs into verifiable, auditable pathway claims with calibrated abstention.

Talk to your PDFs using an LLM.

LLM-friendly PDF splitter & image optimizer. Chunk PDFs by size and downsample images for RAG/Bedrock.

LLM fragment plugin to load a PDF as a sequence of images

Security testing toolkit for LLM-based systems

Tool for monitoring LLM inference metrics

Benchmark the performance (output speed, latency) of OpenAI compatible endpoints

LLM access to pplx-api 3 by Perplexity Labs

PostgreSQL pgvector storage backend for LLM

A modular, async, composable AI pipeline library for building conversational agents and content processing pipelines

LLM serving platform

Production-ready LLM platform building blocks — observability, prompts, eval, RAG, hallucination guards

ocr library

a tool that queries LLMs, analyzes responses, and executes experimental pipelines

LLM plugin to generate few-shot prompts for plugin creation

LLM plugin for loading text from PDF files (local or URL)

Texas Hold'em environment with LLM players

A package to route chat requests between LLMs based on prompt classification

Local preflight checks for LLM provider keys, endpoints, and model configuration

A generic JSON prettier and interactive HTML viewer, built especially for parsing embedded JSON from LLM payloads and responses.

Pricing + release metadata and cost estimation for LLMs

A simple Python SDK to scrape and retrieve pricing information for Large Language Models (LLMs) from an external webpage, with structured models for easy integration and usage.

A library for scraping and managing LLM pricing information

A lightweight LLM-based privacy filter for masking sensitive entities in text.

Probe LLM models for tool-calling support, think block behavior, and response quality across providers.

LLM benchmarking tools for the LLM CLI

A brief description of sl-llm

Generates complete Python projects from a single prompt.

Generate LLM-friendly summaries of Python and Go codebases

Takes a given directory and parses its contents to create a text vectorstore to be consumed in prompts for various LLM models.

Token-aware prompt compilation framework

Plugin to add a --json flag to the llm prompt command

A flexible system for managing and processing prompt templates

A comprehensive framework for systematic A/B testing, optimization, performance analytics, security, and monitoring of LLM prompts across multiple providers with enterprise-ready API

A lightweight Python library for optimizing and cleaning LLM inputs

A CLI tool for managing and comparing LLM prompts using semantic diffing

Lightweight prompt injection detection and blocking

Git-style diff and version control for LLM prompts

Reliable, structured, production-safe LLM outputs with schema validation and auto-repair

Pydantic data models and adapters for the LLM Protocol Suite.

A unified interface for multiple LLM providers

A unified interface for multiple LLM providers with image generation, speech-to-text, and function calling (OpenAI, Anthropic, Gemini, VertexAI, Ollama + DALL-E, Replicate, Whisper, Google Speech, Tools)

A unified source of truth for LLM providers, models, pricing, and capabilities.

A lightweight LLM proxy with logging and admin dashboard

Proxy Server that converts llm request format from one provider to another

A FastAPI proxy server for vLLM w/wo SLURM support and automatic process management

LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

llm proxy server

Run a Python interpreter in the LLM virtual environment

Secure Python code execution sandbox for LLM-generated code

LLM-based qualitative sorting using Swiss-system tournament

cli tool for downloading and quantizing LLMs

A cacheing CLI for quickly asking questions of LLMs

A Redis-based queue task manager for LLM processing with intelligent token budget management

Prompt evaluation and mock LLM for testing

The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.

Real-time observability dashboard for LLM applications. Track prompts, tokens, costs, and latency. One-line integration.

MCP server providing real-time AI model intelligence - pricing, capabilities, and recommendations

LLM with RAG

Это библиотека на Python, предназначенная для упрощения создания и управления моделями генерации с использованием поиска (Retrieval-Augmented Generation, RAG).

Pointwise, Listwise, Pairwise and Setwise Document Ranking with Large Language Models.

Cloud-agnostic rate limit mitigation for LLM APIs

Transform any LLM into a methodical thinker that excels at systematic reasoning like OpenAI o1 and DeepSeek R1

A library for advanced reasoning methods with large language models

Trace and explain LangChain agent reasoning step-by-step

LLM Receipts → This package is now `aiir`. Install: pip install aiir

Record and replay LLM interactions