PyPI agents

Durable, explainable long-term memory for the llm CLI, powered by Engram (Lumetra)

Create ensembles of Large Language Models to query them all at the same time.

A comprehensive evaluation toolkit for Large Language Models

Run evals against prompts using LLM

Drop-in observability for LLM applications — quality scoring, hallucination detection, cost tracking, and agent run debugging.

A project for evaluating reasoning capabilities in large language models (LLMs).

MCP server for agentic LLM evaluation: jury scoring, agent tracing via OpenTelemetry, document-grounded QA generation, PDF reports.

placeholder

A new package that processes news headlines or short text inputs to generate structured summaries of events, such as service disruptions or incidents. It uses an LLM to extract key details like the co

LLM + evolutionary algorithms to optimize programs in multiple languages and domains

LLM plugin for accessing Exa.ai API

LLM explains stack trace for all exceptions. It automatically takes your input code and the error and tries to give a solution.

LLM batch inference latency predictor and profiler CLI tool

Advanced Knowledge Graph Engine with Document Processing, Semantic Search and Multi-LLM Integration

LLM Expect is a minimalist, developer-first SDK for testing LLM-powered Python functions using structured JSONL datasets.

Tools that use LLM to explain datasets

A Lakehouse LLM Explorer. Wrapper for spark, databricks and langchain processes

CLI tool to expose LLMs through messaging clients (Telegram, Discord, Slack, etc.)

A framework that enables efficient extraction of structured data from unstructured text using large language models (LLMs).

Extract structured, validated JSON from any LLM — OpenAI, Anthropic, Gemini — with batch extraction, caching, per-field confidence scoring, schema evolution, multi-schema extraction, output transforms, partial extraction, extraction diff, pipeline extraction, and smart auto-retry.

This package is a utility library for interfacing with multiple Large Language Models (LLMs) using a common interface.

Een package om LLM modellen te initialiseren op basis van provider.

A toolkit for interacting with various Large Language Models

Multi-LLM provider client with automatic failover and priority ordering

Detection and pattern library for LLM agent failures

LLM CLI plugin for fal.ai generative AI models and services

Microlib for the Falcon LLM

Automatic failover between LLM providers. When OpenAI is down, seamlessly switch to Anthropic, Google, or any backup.

A comprehensive Python library for managing fallback mechanisms for Large Language Model (LLM) API calls using LiteLLM

Automated feature engineering using Large Language Models (LLMs) for tabular data

Generate interpretable feature schemas and tabular exports from text, images, tabular data, and video with LLMs

LLM plugin for analyzing FEC campaign finance filings

A Python client for the LLM Feedback API.

A thin, fast, observable Python client for LLMs

A tool to combine files in a folder for LLM processing

Token-efficient data format converter for LLM contexts

AI-powered filesystem cleanup tool with interactive CLI

Load LLM templates from the filesystem

Black-box LLM fingerprinting system for model identification

Access fireworks.ai models via API

One line: which open-source LLM works best on your local machine today.

Pytest plugin for running non-deterministic LLM tests with automatic retry and beautiful reports

a python library that lets you quantize any layer your llm

A prompt graph definition and execution library for LLM app development.

A DSL-based LLM workflow engine that supports multi-model collaboration, dependency management, and result aggregation

Serving files for hungry LLMs

Config-driven, YAML-first open-source LLM training platform

Small CLI playground for Qwen via an OpenAI-compatible LLM Forge gateway.

Minimal llm_formats package exposing a single public function

A configurable forwarder for OpenAI-compatible LLM requests

LLM Foundation Tools

LLM Foundry

Load files from a local directory as fragments

Load documents as fragments

LLM plugin to load entire folder contents as fragments

Load GitHub repository contents as LLM fragments

LLM plugin for pulling Go package docs

LLM fragment loader which converts various formats to Markdown.

Use PyMuPDF to insert PDFs as markdown

Run URLs through the pure.md API

LLM fragments plugin for PyPI packages metadata

Run URLs through the Jina Reader API

A plugin for llm to load Reddit threads as fragments

Load repository contents as LLM fragments using Repomix

LLM plugin for pulling Rust crate docs

Run URLs through the Trafilatura to get plain text

Load SourceHut repository contents as LLM fragments

LLM fragment loader for Python symbols

llm plugins for loading tmux panes

Load bills from Congress.gov as LLM fragments

LLM plugin for loading YouTube subtitles as fragments

Fetch youtube transcripts and convert them into plaintext for llm consumption.

LLM Fragment Loader for pulling ticket conversations from Zoho Desk

Production-ready filesystem access tools for LLMs with TOCTOU protection

Finite State Machines for Large Language Models

Llm function is a decorator that uses llm to assemble reusable workflows from available tools to match input and output models.

Minimal metadata and discovery helpers for typed Python tools used by llm_function runtimes.

A lightweight Python library for creating reliable, contract-driven LLM functions whose core logic is implemented by an LLM.

Build semantic functions.

LLM-powered automated fuzzing tool for Python functions

This is LLM Gateway package

LLM plugin for Google Cloud Vertex AI models including Gemini and Model Garden

LLM plugin to access Google's Gemini family of models

LLM plugin to access Google's Gemini via Code Assist API with OAuth

LLM plugin to access Google's Gemini family of models, with support for YouTube URLs

Agent framework with learning capabilities

Run models distributed as GGUF files

LLM plugin to generate GitHub PR titles/bodies and create PRs using the 'gh' CLI.

AI-powered Git commands for the LLM CLI tool

LLM plugin to generate git commit messages and interactively commit.

Intelligent Git Commit Tool with LLM Integration

GitHub Copilot plugin for LLM CLI tool

LLM plugin to access GitHub Models API

LLM testing framework for validating agent behavior and tool usage

Plugin for LLM adding support for GPT4ALL models

One GPU. Full LLM workflow. Real benchmarks. No cloud required.

LLM ベースのエージェントのワークフローをグラフ形式で記述・実行する軽量ライブラリ