Python agents

LLM API for multiple model providers

Mutation testing for LLM prompts. Find the gaps in your eval suite before production does.

Deterministic VM for LLM program execution

Advanced system information tool for local LLM usage

Schema-driven Named Entity Recognition powered by local LLMs via Ollama

Use an LLM to run inference, for NER (named entity recognition) and/or NEL (named entity linking). Build a knowledge graph. Evaluate results.

A plugin to add support for the Neuralwatt AI inference service to llm

A unified interface for multiple language model providers

Create embeddings using the Nomic API

LLM plugin for models hosted by NOS Cloud

Karpathy-style LLM wiki from your Claude Code, Codex CLI, Cursor, and Obsidian sessions

Access Nous Research models via API

A tool for obfuscating text by manipulating token IDs while preserving token count and structure

Lightweight SDK for LLM inference logging and observability

Context0 SDK — one import, all calls logged

OpenAI-compatible LLM proxy with SQLite request capture, observability, and an admin UI.

LLM plugin providing access to models running on an Ollama server

OneSDK is a Python library that provides a unified interface for interacting with various Large Language Model (LLM) providers.

Conditionally serve content to LLM crawlers in Python web frameworks.

Access OpenAI models via a Codex subscription

LLM plugin for OpenAI and Google image generation and editing

LLM plugin for OpenAI

Access OpenAI models via a Codex subscription

LLM plugin to access OpenHands Cloud API

LLM plugin for models hosted by OpenRouter

Add your description here

A placeholder package for llm-oracle

Multi-agent LLM communication system with ensemble orchestration

An open-source chatgpt tool ecosystem where you can combine tools with chatgpt and use natural language to do anything.

Drop-in OpenTelemetry GenAI observability for any LLM backend — local or cloud.

Validate LLM outputs against schemas with automatic retry and JSON extraction.

Extract and parse JSON from unstructured text outputs from LLMs

Sanitize LLM outputs before HTML, SQL, shell, or markdown sinks. Python port of @mukundakatta/llm-output-sanitizer.

Plugin for LLM adding support for Google's PaLM 2 model

A library to parametrize multiple API calls for LLMs

Multi-agent debate for better AI decisions. Research-backed, local-first.

Parse data from documents optimised for downstream llm tasks.

A simple JSON parsing tool that preprocesses and parses JSON strings.

Microlib for partial deployment of LLMs

Real-time chat between multiple LLMs with human moderator ability

LLM Patch Driver is a framework for patching data objects using LLMs. It can generate and apply a single patch, or start the patching loop to fix complex validation issues.

Robust search/replace file editing for LLM-driven code changes

A tool for tracing LLM requests

Transform enrichment outputs into verifiable, auditable pathway claims with calibrated abstention.

Talk to your PDFs using an LLM.

LLM-friendly PDF splitter & image optimizer. Chunk PDFs by size and downsample images for RAG/Bedrock.

LLM fragment plugin to load a PDF as a sequence of images

Security testing toolkit for LLM-based systems

Tool for monitoring LLM inference metrics

Benchmark the performance (output speed, latency) of OpenAI compatible endpoints

LLM plugin for Perplexity's Agent API

PostgreSQL pgvector storage backend for LLM

A modular, async, composable AI pipeline library for building conversational agents and content processing pipelines

LLM serving platform

Production-ready LLM platform building blocks — observability, prompts, eval, RAG, hallucination guards

ocr library

a tool that queries LLMs, analyzes responses, and executes experimental pipelines

LLM plugin to generate few-shot prompts for plugin creation

LLM plugin for loading text from PDF files (local or URL)

Texas Hold'em environment with LLM players

A package to route chat requests between LLMs based on prompt classification

Local preflight checks for LLM provider keys, endpoints, and model configuration

A generic JSON prettier and interactive HTML viewer, built especially for parsing embedded JSON from LLM payloads and responses.

Pricing + release metadata and cost estimation for LLMs

A simple Python SDK to scrape and retrieve pricing information for Large Language Models (LLMs) from an external webpage, with structured models for easy integration and usage.

A library for scraping and managing LLM pricing information

A lightweight LLM-based privacy filter for masking sensitive entities in text.

Probe LLM models for tool-calling support, think block behavior, and response quality across providers.

LLM benchmarking tools for the LLM CLI

A brief description of sl-llm

Generates complete Python projects from a single prompt.

Generate LLM-friendly summaries of Python and Go codebases

Takes a given directory and parses its contents to create a text vectorstore to be consumed in prompts for various LLM models.

Token-aware prompt compilation framework

Plugin to add a --json flag to the llm prompt command

A flexible system for managing and processing prompt templates

A comprehensive framework for systematic A/B testing, optimization, performance analytics, security, and monitoring of LLM prompts across multiple providers with enterprise-ready API

A lightweight Python library for optimizing and cleaning LLM inputs

A CLI tool for managing and comparing LLM prompts using semantic diffing

Lightweight prompt injection detection and blocking

Git-style diff and version control for LLM prompts

Reliable, structured, production-safe LLM outputs with schema validation and auto-repair

Pydantic data models and adapters for the LLM Protocol Suite.

A unified interface for multiple LLM providers

A unified interface for multiple LLM providers with image generation, speech-to-text, and function calling (OpenAI, Anthropic, Gemini, VertexAI, Ollama + DALL-E, Replicate, Whisper, Google Speech, Tools)

A unified source of truth for LLM providers, models, pricing, and capabilities.

A lightweight LLM proxy with logging and admin dashboard

Proxy Server that converts llm request format from one provider to another

A FastAPI proxy server for vLLM w/wo SLURM support and automatic process management

LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

llm proxy server

Run a Python interpreter in the LLM virtual environment

Secure Python code execution sandbox for LLM-generated code

LLM-based qualitative sorting using Swiss-system tournament