Python agents

Fuzzy search LLM models from models.dev

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers

AI-friendly llms.txt & sitemap generator for websites. Crawl or import sitemaps, filter pages, and generate curated indexes for LLMs.

The /llms.txt file, helping language models use your website

GitHub Action to make documentation more accessible to LLMs.

Lean MCP server for minimal-context docs via llms.txt

Module for parsing llms.txt files

Package for simple usage of diverse LLMs and configuring them using human readable config files

LLMs4PCG is a python package containing required and utility functions as a part of LLMs4PCG competition.

LLMSanitize: a package to detect contamination in LLMs

One-line LLM queries with smart routing and provider failover

Generate llms-brief.txt files from documentation websites using AI

A fast, modern CLI that shows which local LLMs fit on your machine

A structured response wrapper for LLMs using Pydantic.

a Python library designed to simplify interactions with Large Language Models (LLMs) by providing a stateful, fluent interface for managing conversation history, tool usage, and response parsing. It leverages libraries like `mirascope` for LLM calls and `pydantic` for data validation and parsing.

Regression-based LLM benchmark ratings + publication-ready scorecards.

An LLM-powered tool for discovering and analyzing research papers

LLM-powered web scraping in Python

Find the Best Generation Parameters for your LLM & Dataset

A high-performance static internet index for LLM RAG applications

A Python library for LLM security

A lightweight, production-ready service layer for modular, rate-aware LLM integrations

Runtime monitor for LLM agent interaction protocols based on session type theory

Command-line tool to use Large Language Models in your shell,including OpenAI, Anthropic, PalM, Mistral, Cohere, and more.

Comprehensive analysis tool for LLM streaming traffic from PCAP files

Convert natural language to shell commands using LLMs (GPT4All, OpenAI, Ollama)

Strategic APIs to Accelerate LLM Use Cases

Shields your confidential data from third-party LLM providers.

Lightweight validation, repair, and retry helpers for LLM outputs.

Spanish language corpus for LLMShield entity detection.

Multi-provider LLM gateway — one interface, every provider

Client and Tools for LLMs

LLM unified interface

Know where your AI money goes. Track LLM API costs per feature, per model, per user.

A Text2SQL benchmark for evaluation of Large Language Models

Low-code platform to build generative AI apps, chatbots and agents with your data

One command. Full LLM stack. Zero config.

A Python library for building GPT-powered agents with state machine logic and chat history memory.

llmster

A provider-agnostic LLM toolkit with tool calling, skills, and parallel execution.

Adversarial security testing framework for LLM-powered applications

A Python library for reliably extracting structured JSON from text and validating it with Pydantic models.

Prompt Perfection at Your Fingertips

LLMStudio core capabilities for routing llm calls for any vendor. No proxy server required. For that use llmstudio[proxy]

LLMstudio Proxy is the module of LLMstudio that allows calling any LLM as a Service Provider in proxy server. By leveraging LLMstudio Proxy, you can have a centralized point for connecting to any provider running independently from your application.

LLMstudio Tracker is the module of LLMstudio that allows monitoring and logging your LLM calls. By leveraging LLMstudio Tracker, users can gain insights on model performance and streamline development workflows with actionable analytics.

Design and build LLMs.txt knowledge structures by extracting and summarizing web content

AST-aware llms.txt generator for Python and JavaScript/TypeScript codebases

Generate llms.txt from built HTML documentation

Convert llms.txt to Claude Code Skill format

Python SDK, CLI, and Arena for 10 LLM providers. Compare models, synthesize a privacy-aware Best Answer, use MCP tools, fallback, caching, and direct BYOK access.

LLMT aims to make it easy to programatically connect OpenAI and HuggingFace models to your data pipelines, CI/CD, or personal workspaces.

Use LLMs to label any textual dataset

LLM Downstream Task Evaluation Tool.

LLM任务难度评分工具，支持百炼、OpenRouter和Gemini等大模型

A Python bookstore to simplify the definition, execution and chaining of tasks using LLMS.

Enterprise AI Workflow Runtime - Multi-agent LLM pipelines with security, orchestration, and workflow capabilities

A CLI tool that sends prompts to an LLM and outputs responses

Intentionally Simple. Generic LLM interface

Gemini provider for LLMterface

llmtest package

Anthropic provider for llmtest

CLI for llmtest

Core library for llmtest — Pydantic models, assertions, runners

pytest for LLM apps - test for grounding failures, prompt injection, safety, and regressions

Ollama provider for llmtest

OpenAI provider for llmtest

Production-quality performance validation and regression testing for LLM inference systems

pytest plugin for llmtest

A new package that helps developers integration-test AI and LLM applications by validating structured outputs. It takes a user's test scenario or prompt as input, sends it to an LLM, and uses pattern

LLM Tests

A simple llm library.

A framework for evaluating overthinking and basic reasoning capabilities of Large Language Models

Type-safe function registration and validation for LLM function calls

Count tokens and explore chat templates using HuggingFace tokenizers or OpenAI tiktoken

A package with useful functions for working with Large Language Models

Tools using ollama and torch that are easy and nice to have for working with local LLMs

LLM-powered system monitoring with real-time performance insights

A library for extracting topics from text documents using llms.

llm model process for pytorch

A lightweight LLM observability and evaluation framework.

Zero-config decorator for tracing LLM calls

Python bindings for LLMTrace — security-aware LLM observability

Lightweight structured tracing for LLM applications

LLMTracer: A tool to trace the execution of a program that uses LLMs and visualize the results.

Auto-track LLM cost, latency, and usage. Two lines of code, every provider.

End-to-end observability with built-in security guardrails.

A tool to view LLM call traces from JSONL log files.

Lightweight LLM observability. SQLite-based tracing with zero infrastructure.

Python bindings for LLMTrace — security-aware LLM observability

A concise description of your package.

A Python library for language detection and translation using langchain ChatModels

Text translator using OpenAI-like API.

CLI tool for preparing project data for LLM context

A package for LLM tricks

llmtune

Easy-to-use LLM fine-tuning framework