Python agents

Do you want to talk directly to the LLMs? Try llmapi.

A Python library for creating interactive web maps, optimized for LLM-assisted development.

A python package for summarizing text using an LLM model.

OWASP LLM Top 10 security scanner for AI-powered applications

LLM Judge: simple right/wrong voting across models

LLM as Judge

A command-line tool for masking authorship of text, by changing the writing style with a Large Language Model.

Combining LLMs and ASP for intelligent problem-solving and reasoning.

AI-powered email management and automation system: auto-categorize, detect spam, and generate responses with LLM

A easy assist package for Large Language model inference and fine-tuning.

Reliable LLM interaction with pattern matching and retries.

The new package transforms a user’s plain‑text search phrase into a structured, BM25‑ranked list of PostgreSQL search results. It takes the query text as input, forwards it to an LLM that rewrites the

Reliable LLM interaction with pattern matching and retries.

A new package designed to enhance structured text processing by leveraging the capabilities of llmatch-messages. This package will take user-provided text as input and return a well-organized, structu

A new package designed to process and validate user inputs using advanced language models, ensuring structured and consistent responses. This package leverages the capabilities of llmatch-messages to

CLI program for converting natural language text to LaTeX

No BS utilities for developing with LLMs

A CLI tool to find LLM usage accross your repos

LLMAuditor is an execution-based evaluation and monitoring framework for LLM, GenAI, and agentic AI applications, providing hallucination detection, cost tracking, and governance auditing.

🪄 Dataset augmentation using LLMs

☸️ Easy, advanced inference platform for large language models on Kubernetes

LLM Banter: See 2 large language models (LLMs) banter, debate and chat with each other.

A framework for load testing llmbench APIs

Large Language Model Batch Operations

A lightweight CLI tool for managing LLMBoost™ model images and environments.

LLMBOT PLUGIN

Generate Voice From reecho.ai Api In OpenAiBot.

Openaibot Bot Plugin: Sticker,for sending sticker in chat

LLMs at your service

A modular LLM application development framework

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs with optional model registry and usage tracking - deprecated

Low abstraction agentic LLM framework.

A framework-agnostic browser tool for AI agents. Works with Anthropic, OpenAI, LangChain, and any agent framework.

A comprehensive toolkit for building, training, and deploying language models

Using LLMs for compilers

LLMCache is an open-source caching solution designed to operate seamlessly within your cloud infrastructure.

Intelligent caching layer for LLM calls with semantic understanding, async deduplication, and cost control

Drop-in semantic + exact caching layer for LLM applications

A minimal, LLM-friendly CAD library in Python

LLM API calls made piece of cake🍰

Calculate LLM token costs from litellm pricing data

A lite abstraction layer for LLM calls

Python SDK for LLMCaller - A unified interface for LLM providers

Real-time LLM spend enforcement — CLI and tray app

Type-safe LLM output parsing with Pydantic models and Jinja2 prompt templates

llmcc brings multi-depth architecture graphs for code understanding and generation.

大语言模型仿openai接口实现

LLM-based Chatbot

LLMChatLinker is a Middleware SDK designed to facilitate interaction between clients and Large Language Models (LLMs).

A chess LLM benchmark scored against a local UCI master engine.

Play international chess against AI opponents powered by local LLMs

CI-native regression testing and migration for LLMs

Utilities for cleaning and normalizing raw LLM output

Llmcode is AI pair programming in your terminal

Open-source AI agent runtime for any LLM — production-grade coding agent with multi-layer memory, multi-agent orchestration, and defense-in-depth security

Installer for the llmcode AI pair programming CLI tool.

A Python library for extracting code snippets using LLMs

Implementation of LLMs in pytorch

Research library for black-box experiments on language models.

LLMCompiler

A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation.

A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation.

LLMConf unifies the loading and generation configurations of various LLM backends (e.g. `openai`, `transformers`, `vllm`), simplifying parameter control for experiments and testing.

Python SDK for the LLM Conveyors AI Agent Platform API

LLMCore: Essential tools for LLM development - models, prompts, embeddings, agents, chains, and more.

Active memory and executive control for AI coding agents. Classifies user prompts against a curated tripwire store, injects the matched lessons into the agent's working context via a Claude Code UserPromptSubmit hook, before the agent reasons about the task.

llmcost

A framework for selectively invoking LLMs and distilling repeated workloads into smaller models

A minimal CLI for interacting with LLMs via LiteLLM and MCP

Specwright - Python framework for LLM-assisted development with runtime spec validation

A professional CLI tool for interacting with OpenAI and Anthropic LLMs with cost tracking

A tool to manage and generate context for Large Language Models from project files

Cycle through multiple LLM providers with smart fallback, load balancing, and unified API with real-time FastAPI dashboard, resilient streaming failover, Pydantic structured output, prompt caching, token budgets, and local/cloud key rotation.

CLI tool for generating LLM context from GitHub repositories

LLMdantic is a Python package that provides structured interaction with LLMs.

rubrics

llm dataset

A simple interface to models.dev, the open database of AI model specs, pricing and capabilities

Structured debug snapshots for LLM-assisted debugging

Distributed LLM Evaluation Benchmark Server

triton inference service of llama

LLMDet: A Large Language Models Detection Tool

Tools for LLM applications development

git diff for LLM prompts

A simple directory tree generator for llm

LLM Development Kit for common APIs

Ask GPT to run a command

MCP server with RAG for llms.txt documentation

Automate documentation generation using the LLM of your choice!

Using LLM to parse PDF and get better chunk for retrieval

Agent-first documentation platform (CLI and server)

Find LLM cost leaks before your bill does. Static analysis for Anthropic and OpenAI client code.

轻量级 LLM 命令行工具与 Python 库，支持兼容 OpenAI Chat Completions 格式的任意 API 端点。

LLM Detection and Response — tamper-evident audit trails for LLM traffic