Python agents

Load LLM templates from local paths and cloud storage (S3, GCS, Azure) using any supported fsspec URL scheme.

Laod LLM templates from GitHub repositories

LLM template loader for Latitude - Load prompts from Latitude as LLM templates

Load LLM templates from SourceHut repositories

A simple CLI to chat with LLM Models

A terminal-based UI for LLMs with PydanticAI and MCP integration

Deterministic testing framework for LLM-powered apps — record/replay cassettes, eval scoring, regression testing

A package for generating code using various AI models.

Professional-grade LLM evaluation framework with ZENO-style HTML reports and enhanced sample analysis

Comprehensive testing suite for LLM evaluation: hallucination detection, consistency, robustness, safety, and multi-language code generation assessment.

Remove characters from text while keeping it understandable for LLMs, saving on inference costs.

Run large language models.

A lightweight, rule-based text splitter for LLM context window management, handles multiple file formats and enriches chunks with metadata.

A placeholder package for LLM The Game

Token-bucket rate limiter for LLM API calls with per-model limits

Token-efficient code analysis for LLMs. 5-layer stack: AST, Call Graph, CFG, DFG, PDG. 95% token savings. 17 languages.

LLM fragment & template loaders for tmux scrollback and helpful prompt templates

simple llm based tools to access from cli

Large language model to corpus

Tiny wrapper exposing Prompture helpers to convert LLM output into JSON.

A robust integration engine that enhances communication between LLMs and MCP servers/functions with validation, retries, and safety.

Tiny wrapper exposing Prompture helpers to convert LLM output into TOON.

A todo application MCP server designed for AI agent task management

llm together plugin

LLM plugin for models hosted by Together AI

Pre-call cost estimation, tracking, and budgets for OpenAI, Gemini, and Claude

Token cost control and auto-optimization for LLM apps — compress prompts, estimate costs, enforce budgets, route to cheap models, and cut LLM spend by up to 60%

Cut your LLM API bill by 30-70% with zero accuracy loss

A package to track LLM token usage in context

A lightweight Python library for tracking OpenAI and Anthropic SDK costs with budget alerts

Tokenizer utilities for LLM inference

LLM tokenizers tools

Multi-provider token analysis toolkit for LLMs

Open benchmark of LLM tokenization across 5 providers — offline vs empirical calibration deltas.

Profile your LLM payloads. Find the waste. Cut the cost.

Lightweight drop-in Python decorator to track costs, monitor token usage, and enforce budget/rate limits for LLM API calls

Biblioteca Python que simplifica e unifica a definição e chamada de ferramentas para grandes modelos de linguagem (LLMs). Compatível com Ollama, LangChain, OpenAI e outros frameworks.

A library to easily build LLM agents with tool-using capabilities.

Implements a tool registry to make tool calling easier when using LLMs

Tool calling runtime for text-only LLMs with LangChain support

Library for interacting with the LLM Tool Store API

llm-toolbox is now LMtoolbox

A unified tool calling interface for LLM providers

LLM工具调用框架，同时提供 HTTP API 和 MCP Server 两种接入方式

LLM Finetuning resource hub + toolkit

The foundational shared event schema for the LLM Developer Toolkit

ToolPy is a Python module made to facilitate the creation of tools using LLMs.

LLM Fine Tuning

Manage Anki cards with the LLM tool

A tool plugin for LLM to enable web search with Brave Search API

MCP server for searching local browser history files. Also compatible with llm-tools.

A CLI tool to interact with various LLM APIs

Expose Datasette instances to LLM as a tool

Run commands in a Docker container via an LLM tool

LLM plugin providing tools for editing files

A tool plugin for LLM to enable web search with Exa

A tool plugin for LLM to enable executing shell commands on the user's system.

Instant integration of external tools into LLM applications via automatic function calling.

wrapper for cased-kit's code analysis toolset

Expose offline wiki and stack exchange archives to llms.

MCP support for LLM CLI

Memory tools for LLM

a plugins that allow to use OpenAPI as a tools

LLM tools for reading, writing and changing text files

JavaScript execution as a tool for LLM

A tool plugin for LLM to enable searching over embeddings

Grants LLM the ability to glob, grep, and view files within a directory

A tool to search the web using SearXNG.

LLM plugin: SearXNG search tool returning LLM-friendly markdown output

Reusable Flask server for LLM backends (Ollama, LM Studio) with tool calling

Make simple_eval available as an LLM tool

Add Skills bundles to the LLM CLI tool

LLM tools for running queries against SQLite

LLM tools for todo management

Trigger an LLM tools error, useful for testing

Make YouTube transcripts available to llm

LLM access to Topology

Small(7B and below), production-ready finetuned LLMs for a diverse set of useful tasks.

Use LLM to translate in your shell

Sample LLM traces by risk, errors, latency, and deterministic ids. Python port of @mukundakatta/llm-trace-sampler.

End-to-end observability with built-in security guardrails.

Meta-package for LLM Tracekit - OpenTelemetry instrumentations for LLM providers.

OpenTelemetry instrumentation for Anthropic.

OpenTelemetry instrumentation for AWS Bedrock.

Core utilities for LLM Tracekit and Coralogix Guardrails SDK.

OpenTelemetry instrumentation for Google Gemini.

OpenTelemetry instrumentation for Google ADK (Agent Development Kit).

OpenTelemetry instrumentation for LangChain.

OpenTelemetry instrumentation for LangGraph.

OpenTelemetry instrumentation for LiteLLM.

OpenTelemetry instrumentation for Microsoft Foundry (azure-ai-projects).

OpenTelemetry instrumentation for OpenAI.

OpenTelemetry instrumentation for OpenAI Agents SDK.

OpenTelemetry instrumentation for Strands Agents SDK.

An embedding model toolkit; fine-tune SOTA LLMs on knowledge bases rapidly.

🤖 Train your LLMs with ease and fun.

Your personal Language Translator powered by LLMs.

Plugin for llm adding support for 🤗 Hugging Face Transformers