Python agents

A Python package for extracting confidence scores from LLM models outputs, particularly using log probabilities

LLM Connect API

A unified Python connector for multiple LLM providers with YAML-driven configuration.

A library of connectors for popular AI platforms

Langchain-compatible deliberation and consensus framework using multiple LLMs.

Evaluate LLM consistency under input perturbation using CAT framework metrics

Command-line interface for LLMs with advanced features like tool calling, file handling, and more.

LLM plugin implementing Andrej Karpathy's model consortium tweet

A robust content extractor for LLM outputs with support for JSON, XML, HTML, and code blocks

A simple and customizable content filter for LLMs

Share code with LLMs via Model Context Protocol or clipboard. Rule-based customization enables easy switching between different tasks (like code review and documentation). Code outlining support is included as a standard feature.

Export any project to a single text file optimized for LLM context

A tool to combine multiple files into a single file for AI context

A small CLI tool to collect source files from a repository into a single Markdown document, ready to share with an LLM.

A middleware layer for managing, budgeting, and optimizing LLM context windows.

Production-grade LLMOps infrastructure for context window management, token counting, document chunking, and compression

LLM context generator

Add your description here

Turn your entire codebase into a single prompt-ready text file.

Scope your AI context before it explodes

State-contracted verification and explainable retrieval gating for agentic RAG.

Composable building blocks for LLM context engineering

Compress your local LLM KV cache with 5.3× memory reduction - Install: pip install llm-contextlens

Define, version, and enforce behavioral contracts on LLM function calls

LLM Output Validation, Linting, and Assertion Layer

A tool for LLM agent conversations

A Python library for parsing LLM conversation JSON files into RAG-optimized format

Easily browse and resume previous conversations.

Unified async cookie/session bridge for major AI web apps.

LLM Coop Node — connect your GPU to a coordinator for shared inference

A plugin for https://github.com/simonw/llm for running local CoreML .mlpackage model files.

Portable, model-agnostic memory layer for LLM conversations

Cost tracking for OpenAI, Gemini, and Claude APIs with session management

Real-time cost tracking, budget enforcement, and usage analytics for LLM applications

Estimate LLM request cost and enforce per-request or per-session budgets. Python port of @mukundakatta/llm-cost-guard.

Real-time cost monitoring and budget enforcement for LLM API calls

Python SDK for LLM Cost Monitor - Track, aggregate, and analyze LLM usage costs

Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.

A tiny Python library for tracking LLM token usage, latency, and estimated cost - with per-agent-step cost attribution for LangGraph, a local dashboard, and litellm-backed pricing for hundreds of models.

Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.

LLM API call token usage-based expense tracker

Track LLM API costs per request. Know where your tokens go.

LLM cost calculator for major providers

Use LLM to generate and execute commands in your shell

Multi-LLM council system with peer review and synthesis

LLM-based council/consensus tool for multi-persona AI deliberation

Multi-model LLM deliberation with anonymized peer review

Add your description here

A web crawler CLI tool for preparing content for LLM ingestion and vector databases

Create an LLM XML context document from an llms.txt file

A middleware layer for managing, budgeting, and optimizing LLM context windows.

Best open-source document to markdown converter for LLM training data. Convert PDF, Word, PowerPoint, Excel, images, URLs to clean markdown, JSON, HTML locally. Alternative to Unstructured, Docling, Marker, MarkItDown, MinerU, PaddleOCR, Tesseract

A Python package for calculating key metrics to assess LLM performance in various tasks, including extracting structured dataa.

A processor for LLM tasks

Generate synthetic evaluation datasets from your own documents.

LLM access to Databricks model serving

A dataclass interface for llms

极简高性能流式数据加工库

Python3 library for converting between various LLM dataset formats.

Meta-library that combines all llm-dataset-converter libraries.

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

RAG llm datatech

Placeholder package to reserve the llm-deep-bloom name on PyPI

LLM plugin of various deep research implementations

Access deepseek.com models via API

LLM access to DeepSeek's API

Yet another LLM access to DeepSeek's API

Model-agnostic LLM output degeneration detector — 4-signal composite scoring in a single pass

MCP server for multi-LLM deliberation with anonymized peer review

Minimal Python package: llm_dep_extractor

Transparent, probabilistic classification of text as human-generated or LLM-generated

LLM plugin to access Devin API

LLM development debug layer - every API call recorded, nothing lost. Reasoning tokens, prompt diff, session timeline, LangChain/LlamaIndex integration.

LLM plugin to create a hierarchical summary description of a project

A minimal, auditable Python library for calling multiple LLM providers. Lightweight LiteLLM alternative.

A Python package for managing LLM chat conversation history

Deterministic codebase context retrieval for LLMs

A CLI tool for comparing LLM outputs — semantically, visually, and at scale

LLM plugin for models hosted by DigitalOcean AI

A light-weight Python library 🐍 for deploying DAG chains of customizable Large Language Model operations. Leveraging the asyncio framework, LLM-Director allows developers to create, manage, and orchestrate actions and processes in an efficient and scalable manner. With its unique structure and integration with FastAPI, LLM-Director offes a robust solution for building applications, API endpoints, and workflow automation systems.

LLM Discord Bot

LLM model discovery and tracking system for real-time monitoring of available models across multiple providers

Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics

Knowledge Distillation for Large Language Models

Model distiller automator — recursively drives an LLM with seed prompts and stores compressed outputs in SQLite

Extract LLM DNA vectors — low-dimensional representations that capture functional behavior and model evolution.

AI-powered documentation generator for code projects

Ask questions of LLM documentation using LLM

Generate Python docstrings automatically with LLM and syntax trees.

Code to generate docstrings for Python code using GPT-4 etc.

A Python library for LLM-powered document analysis and processing

LLM integrations for DocumentCloud

A modular, block-by-block LLM building library

Production-grade LLM output validation package. Validates LLM outputs using your own LLM when needed — and no LLM when not.

Local-first semantic drift detection for LLM outputs.

llm plugin for dspy

LLM plugin for Duckduckgo AI Chat service

Debug plugin for LLM