PyPI agents

LLM context generator

Add your description here

Turn your entire codebase into a single prompt-ready text file.

Scope your AI context before it explodes

State-contracted verification and explainable retrieval gating for agentic RAG.

Composable building blocks for LLM context engineering

Compress your local LLM KV cache with 5.3× memory reduction - Install: pip install llm-contextlens

Define, version, and enforce behavioral contracts on LLM function calls

LLM Output Validation, Linting, and Assertion Layer

A tool for LLM agent conversations

A Python library for parsing LLM conversation JSON files into RAG-optimized format

Easily browse and resume previous conversations.

Unified async cookie/session bridge for major AI web apps.

LLM Coop Node — connect your GPU to a coordinator for shared inference

A plugin for https://github.com/simonw/llm for running local CoreML .mlpackage model files.

Portable, model-agnostic memory layer for LLM conversations

Cost tracking for OpenAI, Gemini, and Claude APIs with session management

Real-time cost tracking, budget enforcement, and usage analytics for LLM applications

Estimate LLM request cost and enforce per-request or per-session budgets. Python port of @mukundakatta/llm-cost-guard.

Real-time cost monitoring and budget enforcement for LLM API calls

Python SDK for LLM Cost Monitor - Track, aggregate, and analyze LLM usage costs

Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.

A tiny Python library for tracking LLM token usage, latency, and estimated cost.

Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.

LLM API call token usage-based expense tracker

Track LLM API costs per request. Know where your tokens go.

LLM cost calculator for major providers

Use LLM to generate and execute commands in your shell

Multi-LLM council system with peer review and synthesis

LLM-based council/consensus tool for multi-persona AI deliberation

Multi-model LLM deliberation with anonymized peer review

Add your description here

A web crawler CLI tool for preparing content for LLM ingestion and vector databases

Create an LLM XML context document from an llms.txt file

A middleware layer for managing, budgeting, and optimizing LLM context windows.

Best open-source document to markdown converter for LLM training data. Convert PDF, Word, PowerPoint, Excel, images, URLs to clean markdown, JSON, HTML locally. Alternative to Unstructured, Docling, Marker, MarkItDown, MinerU, PaddleOCR, Tesseract

A Python package for calculating key metrics to assess LLM performance in various tasks, including extracting structured dataa.

A processor for LLM tasks

Generate synthetic evaluation datasets from your own documents.

LLM access to Databricks model serving

A dataclass interface for llms

极简高性能流式数据加工库

Python3 library for converting between various LLM dataset formats.

Meta-library that combines all llm-dataset-converter libraries.

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

RAG llm datatech

Placeholder package to reserve the llm-deep-bloom name on PyPI

LLM plugin of various deep research implementations

Access deepseek.com models via API

LLM access to DeepSeek's API

Yet another LLM access to DeepSeek's API

Model-agnostic LLM output degeneration detector — 4-signal composite scoring in a single pass

MCP server for multi-LLM deliberation with anonymized peer review

Minimal Python package: llm_dep_extractor

Transparent, probabilistic classification of text as human-generated or LLM-generated

LLM plugin to access Devin API

LLM development debug layer - every API call recorded, nothing lost. Reasoning tokens, prompt diff, session timeline, LangChain/LlamaIndex integration.

LLM plugin to create a hierarchical summary description of a project

A minimal, auditable Python library for calling multiple LLM providers. Lightweight LiteLLM alternative.

A Python package for managing LLM chat conversation history

Deterministic codebase context retrieval for LLMs

A CLI tool for comparing LLM outputs — semantically, visually, and at scale

LLM plugin for models hosted by DigitalOcean AI

A light-weight Python library 🐍 for deploying DAG chains of customizable Large Language Model operations. Leveraging the asyncio framework, LLM-Director allows developers to create, manage, and orchestrate actions and processes in an efficient and scalable manner. With its unique structure and integration with FastAPI, LLM-Director offes a robust solution for building applications, API endpoints, and workflow automation systems.

LLM Discord Bot

LLM model discovery and tracking system for real-time monitoring of available models across multiple providers

Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics

Knowledge Distillation for Large Language Models

Model distiller automator — recursively drives an LLM with seed prompts and stores compressed outputs in SQLite

Extract LLM DNA vectors — low-dimensional representations that capture functional behavior and model evolution.

AI-powered documentation generator for code projects

Ask questions of LLM documentation using LLM

Generate Python docstrings automatically with LLM and syntax trees.

Code to generate docstrings for Python code using GPT-4 etc.

A Python library for LLM-powered document analysis and processing

LLM integrations for DocumentCloud

A modular, block-by-block LLM building library

Production-grade LLM output validation package. Validates LLM outputs using your own LLM when needed — and no LLM when not.

Local-first semantic drift detection for LLM outputs.

llm plugin for dspy

LLM plugin for Duckduckgo AI Chat service

Debug plugin for LLM

Carbon-aware scheduling and telemetry for LLM applications

Add your description here

Use LLM to edit source files

A CLI tool to edit and chat with files using LLMs

Mathematical health monitor for LLMs — detect degradation and hallucination without NLP

[IMPORTANT: This library is now part of LangChain, follow its official documentation] A caching layer for LLMs that exploits Elasticsearch, fully compatible with LangChain caching, both for chat and embeddings models.

LLM plugin for models hosted by ElectronHub

LLM plugin providing access to the ELIZA chatbot

Send emails via macOS Mail.app — compose, draft, send with AppleScript

Embedding models from Gemini

Dummy llm plugin for demonstration purposes

Embedding models from Jina AI

Embedding models using Ollama pulled models

Run embedding models using ONNX

LLM plugin for embedding evaluation with semantic scoring

A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).