Python agents

LLM redis中介的客户端程序

A reusable library for LLM clients with LangChain framework

Generate embeddings for images and text using CLIP with LLM

An LLM CLI plugin for Cloudflare Workers AI models.

LLM plugin for clustering embeddings

A drop-in replacement for sklearn clustering models, this package optimizes sklearn clusters using LLMs

Use LLM to generate and execute commands in your shell

Use LLM to generate commands for your shell

Use LLM to generate commands for your shell: specialized for qwen3

Python CLI tool that leverages LLMs to generate and execute shell commands through natural language input

Multi-user web cockpit for Ollama: dashboard + chat + admin, pip-installable in one process

An OpenAI LLM based CLI coding assistant.

A tool to help with copying and pasting context into LLM chats (Deprecated: Renamed to llm-context)

A tool to generate comprehensive context for LLMs from any codebase.

Placeholder package for llm-dev

python code executor tool that takes fuzzy input text to extract and execute code designed for LLM applications

Ultra-fast intelligent code analysis tool for LLM context generation with Tree-sitter

Command line tool to code review GitHub pull requests with LLMs.

CLI guardrail for catching stale Python APIs before runtime.

Useful classes and methods for researching code-generation by LLMs.

Generate structured Context Packs for AI coding tools by analyzing your codebase.

llm による自立型 Cli コーディングエージェントライブラリ

Plugin for LLM adding support for Cohere's Generate and Summarize models

Access the Cohere Command R family of models

A plugin for llm that generates commit messages

LLM-friendly replacement for git diff --staged

A Python wrapper for managing OpenAI API and other LLM models.

Dynamic serializer for LLM Compact Hierarchical Formats.

LLM Comparator: An interactive visualization tool for side-by-side LLM evaluation

LLM plugin to compare responses from multiple language models

A JupyterLab extension.

Use LLM to generate commands for your shell

A library for LLM text completion using LiteLLM

Llm Compliance Comparison tools for AI agents. Capabilities: compare providers, recommend for use case, provider risk profile. Built by MEOK AI Labs.

A library of ready-to-use LLM components

Arithmetic compression using Llama LLM models

A provider-agnostic SDK for LLM, image, video, and embedding model clients

A Python package for extracting confidence scores from LLM models outputs, particularly using log probabilities

LLM Connect API

A unified Python connector for multiple LLM providers with YAML-driven configuration.

A library of connectors for popular AI platforms

Langchain-compatible deliberation and consensus framework using multiple LLMs.

Evaluate LLM consistency under input perturbation using CAT framework metrics

Command-line interface for LLMs with advanced features like tool calling, file handling, and more.

LLM plugin implementing Andrej Karpathy's model consortium tweet

A robust content extractor for LLM outputs with support for JSON, XML, HTML, and code blocks

A simple and customizable content filter for LLMs

Share code with LLMs via Model Context Protocol or clipboard. Rule-based customization enables easy switching between different tasks (like code review and documentation). Code outlining support is included as a standard feature.

Export any project to a single text file optimized for LLM context

A tool to combine multiple files into a single file for AI context

A small CLI tool to collect source files from a repository into a single Markdown document, ready to share with an LLM.

A middleware layer for managing, budgeting, and optimizing LLM context windows.

Production-grade LLMOps infrastructure for context window management, token counting, document chunking, and compression

LLM context generator

Add your description here

Turn your entire codebase into a single prompt-ready text file.

Scope your AI context before it explodes

State-contracted verification and explainable retrieval gating for agentic RAG.

Composable building blocks for LLM context engineering

Compress your local LLM KV cache with 5.3× memory reduction - Install: pip install llm-contextlens

Define, version, and enforce behavioral contracts on LLM function calls

LLM Output Validation, Linting, and Assertion Layer

A tool for LLM agent conversations

A Python library for parsing LLM conversation JSON files into RAG-optimized format

Easily browse and resume previous conversations.

Unified async cookie/session bridge for major AI web apps.

LLM Coop Node — connect your GPU to a coordinator for shared inference

A plugin for https://github.com/simonw/llm for running local CoreML .mlpackage model files.

Portable, model-agnostic memory layer for LLM conversations

Cost tracking for OpenAI, Gemini, and Claude APIs with session management

Real-time cost tracking, budget enforcement, and usage analytics for LLM applications

Estimate LLM request cost and enforce per-request or per-session budgets. Python port of @mukundakatta/llm-cost-guard.

Real-time cost monitoring and budget enforcement for LLM API calls

Python SDK for LLM Cost Monitor - Track, aggregate, and analyze LLM usage costs

Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.

A tiny Python library for tracking LLM token usage, latency, and estimated cost - with per-agent-step cost attribution for LangGraph, a local dashboard, and litellm-backed pricing for hundreds of models.

Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.

LLM API call token usage-based expense tracker

Track LLM API costs per request. Know where your tokens go.

LLM cost calculator for major providers

Use LLM to generate and execute commands in your shell

Multi-LLM council system with peer review and synthesis

LLM-based council/consensus tool for multi-persona AI deliberation

Multi-model LLM deliberation with anonymized peer review

Add your description here

A web crawler CLI tool for preparing content for LLM ingestion and vector databases

Create an LLM XML context document from an llms.txt file

A middleware layer for managing, budgeting, and optimizing LLM context windows.

Best open-source document to markdown converter for LLM training data. Convert PDF, Word, PowerPoint, Excel, images, URLs to clean markdown, JSON, HTML locally. Alternative to Unstructured, Docling, Marker, MarkItDown, MinerU, PaddleOCR, Tesseract

A Python package for calculating key metrics to assess LLM performance in various tasks, including extracting structured dataa.

A processor for LLM tasks

Generate synthetic evaluation datasets from your own documents.

LLM access to Databricks model serving

A dataclass interface for llms

极简高性能流式数据加工库

Python3 library for converting between various LLM dataset formats.

Meta-library that combines all llm-dataset-converter libraries.