PyPI agents

Pydantic-AI models for AgentPool

LLMling provider based on the package 'llm'

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

LLMLink is a Python package that allows users to easily create LLM-powered Gradio applications

Add your description here

A library helps to chat with all kinds of LLMs consistently.

Loads a Langchain LLM by model name as a string.

High-performance columnar scan engine for LLM logs stored as JSONL

A Python package for manuscript management, designed to handle hierarchical structures of sections and subsections.

A unified interface for interacting with multiple LLMs and generative AIs.

A Shiny app to convert LLM Markdown exports to PDF with Quarto

A custom LLM-based git merge driver.

SDK for interfacing with core models hosted by LLM Solutions

A library designed to harness the diversity of thought by combining multiple LLMs.

AI pair programmer

Automatic cost tracking and observability for LLM applications

Automatic cost tracking and observability for LLM applications

Professional open source client for running large language models locally

Zero-cost local mock server for LLM API resilience testing

An LLM-powered mock API server that dynamically generates realistic API responses based on OpenAPI/Swagger specifications.

Making agents cuter

LLM-powered bioinformatics pipeline generation from natural language

Compositional framework for LLMs

Observability and monitoring for AI apps

A library to talk to different language models

AI pipeline framework for Python.

Create a Python package.

Reduce LLM costs by 90% - AI recommendations with NO API keys needed!

Predictive resource-pressure instrumentation and runtime guardrails for systems processing untrusted inputs

Llmovoice python library

A test package for llm

Extract structured, LLM-ready content from any website — adaptive engine, no LLMs required

LLM-powered FFmpeg command assistant

A CLI tool for LLM performance testing

LLM-powered chart generation Python SDK — create charts with natural language

LLMPipeline is a Python package designed to optimize the performance of tasks related to Large Language Models (LLMs)

Runtime prompt control, versioning, and user management for production apps

A package for using llm models with api

LLM Package Manager — download, run, and share AI models from the command line

Large Language Models' pool management library

The Python library that lets you spin up any LLM with a single function. Route between local and remote LLMs with a unified interface.

Node execution agent for llm-port cluster-managed runtimes.

CLI installer and management tool for the llm.port platform

A package for calculating perplexity using various language models

Fast, offline-first LLM pricing lookup with auto-sync from LiteLLM data. Get token costs, context windows, and capabilities for 2500+ models.

Compare LLM API costs across providers from the command line

CLI tool to print directory structure and file contents for LLM context generation

A simple framework for LLM-powered applications

A Python package for creating and running LLM programs.

A unified framework for interacting with various LLM providers through a consistent interface with batch processing, templating, and rate limiting.

Static security scanner for LLM and agentic source code — finds prompt-injection, context-leak, PII, RAG, and agent-tool vulnerabilities before deployment.

A comprehensive LLM Prompt Management System

Version, compare, and manage your LLM prompts. No API keys required. Bring your own model.

A lightweight set of tools to use several llm and embeddings apis

OpenAI-compatible LLM reverse proxy with real-time conversation analytics

Easily interact with all main LLMs

Automatically generated LLM models for llmpy-lib

todo

LLM Quality Gate - A provider-agnostic evaluation framework for LLM applications

A package for querying various LLM providers

LLMRails SDK

Intercept OpenAI inputs

A CLI tool to check if your local hardware can run a Hugging Face LLM.

Recommendation systems with LLMs from Shaped.ai

Prompt regression testing for RAG pipelines. Like git diff, but for AI.

A lightweight Python library providing easy access to popular LLM model names, metadata (context windows, capabilities, pricing tiers), and support definitions. Born from a failed experiment on context data compression for LLMs with finite context windows, this library helps developers manage model names, validate support, search by capabilities, and find models by requirements without hardcoding strings or maintaining spreadsheets.

Deterministic replay debugger for LLM agents

A package for building and managing tools for Large Language Models

轻量级的 LLM 响应格式化工具，支持标准响应和流式响应

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs

LLMRing public model registry CLI and tools (manual curation workflow)

LLMRing core server: alias sync, receipts, and usage logging (key-scoped, no users)

A professional Git-based Skill management library for LLM agents.

A unified framework for LLM routing and evaluation.

LLM Stack Python SDK

LlmRush: A Python package for training and Inference language models

A unified interface for multiple LLM providers

MCP server to bridge LLM calls via Model Context Protocol

A simple example package

Fuzzy search LLM models from models.dev

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers

AI-friendly llms.txt & sitemap generator for websites. Crawl or import sitemaps, filter pages, and generate curated indexes for LLMs.

The /llms.txt file, helping language models use your website

GitHub Action to make documentation more accessible to LLMs.

Lean MCP server for minimal-context docs via llms.txt

Module for parsing llms.txt files

Package for simple usage of diverse LLMs and configuring them using human readable config files

LLMs4PCG is a python package containing required and utility functions as a part of LLMs4PCG competition.

LLMSanitize: a package to detect contamination in LLMs

One-line LLM queries with smart routing and provider failover

Generate llms-brief.txt files from documentation websites using AI

A fast, modern CLI that shows which local LLMs fit on your machine

A structured response wrapper for LLMs using Pydantic.

a Python library designed to simplify interactions with Large Language Models (LLMs) by providing a stateful, fluent interface for managing conversation history, tool usage, and response parsing. It leverages libraries like `mirascope` for LLM calls and `pydantic` for data validation and parsing.