A simple Python SDK to scrape and retrieve pricing information for Large Language Models (LLMs) from an external webpage, with structured models for easy integration and usage.

llm-pricing

A library for scraping and managing LLM pricing information

llm-privacy-filter

A lightweight LLM-based privacy filter for masking sensitive entities in text.

llm-probe

Probe LLM models for tool-calling support, think block behavior, and response quality across providers.

llm-profile

LLM benchmarking tools for the LLM CLI

llm-profiler

A brief description of sl-llm

llm-project-builder

Generates complete Python projects from a single prompt.

llm-project-summarizer

Generate LLM-friendly summaries of Python and Go codebases

llm-prompt-creator

Takes a given directory and parses its contents to create a text vectorstore to be consumed in prompts for various LLM models.

llm-prompt-forge

Token-aware prompt compilation framework

llm-prompt-json

Plugin to add a --json flag to the llm prompt command

llm-prompt-manager

A flexible system for managing and processing prompt templates

llm-prompt-optimizer

A comprehensive framework for systematic A/B testing, optimization, performance analytics, security, and monitoring of LLM prompts across multiple providers with enterprise-ready API

llm-prompt-refiner

A lightweight Python library for optimizing and cleaning LLM inputs

llm-prompt-semantic-diff

A CLI tool for managing and comparing LLM prompts using semantic diffing

llm-prompt-shield

Lightweight prompt injection detection and blocking

llm-promptdiff

Git-style diff and version control for LLM prompts

llm-promptguard

Reliable, structured, production-safe LLM outputs with schema validation and auto-repair

llm-prompting-gen

llm-protocol-suite

Pydantic data models and adapters for the LLM Protocol Suite.

llm-provider

A unified interface for multiple LLM providers

llm-provider-factory

A unified interface for multiple LLM providers with image generation, speech-to-text, and function calling (OpenAI, Anthropic, Gemini, VertexAI, Ollama + DALL-E, Replicate, Whisper, Google Speech, Tools)

llm-providers-list

A unified source of truth for LLM providers, models, pricing, and capabilities.

llm-proxier

A lightweight LLM proxy with logging and admin dashboard

llm-proxy-gateway

Proxy Server that converts llm request format from one provider to another

llm-proxy-ondemand

A FastAPI proxy server for vLLM w/wo SLURM support and automatic process management

llm-proxy-server

LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

llm-proxypy

llm proxy server

llm-python

Run a Python interpreter in the LLM virtual environment

llm-python-sandbox

Secure Python code execution sandbox for LLM-generated code

llm-qualitative-sort

LLM-based qualitative sorting using Swiss-system tournament

llm-quantkit

cli tool for downloading and quantizing LLMs

llm-questioncache

A cacheing CLI for quickly asking questions of LLMs

llm-queue-task-manager

A Redis-based queue task manager for LLM processing with intelligent token budget management

llm-quick-tools

Prompt evaluation and mock LLM for testing

llm-quiver

The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.

llm-radar

Real-time observability dashboard for LLM applications. Track prompts, tokens, costs, and latency. One-line integration.

llm-radar-mcp

MCP server providing real-time AI model intelligence - pricing, capabilities, and recommendations

llm-rag

LLM with RAG

llm-rag-builder

Это библиотека на Python, предназначенная для упрощения создания и управления моделями генерации с использованием поиска (Retrieval-Augmented Generation, RAG).

llm-rankers

Pointwise, Listwise, Pairwise and Setwise Document Ranking with Large Language Models.

llm-rate-guard

Cloud-agnostic rate limit mitigation for LLM APIs

llm-reasoner

Transform any LLM into a methodical thinker that excels at systematic reasoning like OpenAI o1 and DeepSeek R1

llm-reasoners

A library for advanced reasoning methods with large language models

llm-reasoning-tracer

Trace and explain LangChain agent reasoning step-by-step

llm-receipts

LLM Receipts → This package is now `aiir`. Install: pip install aiir

llm-recorder

Record and replay LLM interactions

llm-recovery

Attack recovery support system using an LLM

llm-recursive

A Python framework for building intelligent, recursive task decomposition systems powered by Large Language Models

llm-redact

Privacy-first text redaction using local LLM models with rule generation capabilities

llm-redacted

A lightweight, zero-dependency output sanitizer for secrets, API keys, and PII.

llm-reflection

This system utilizes a large language model (LLM) and reflection

llm-refresh-wheel

Keep your local LLM fresh without forgetting what it already knows — replay buffers + forgetting metrics + auto-rollback for continual fine-tuning

llm-registry

A centralized registry for discovering and managing LLM model capabilities. Track model features, costs, and limitations across providers like OpenAI and Anthropic. Supports both verified model definitions and user-managed entries with local storage.

llm-regression-tester

A flexible library for testing LLM responses against predefined rubrics using OpenAI's API for automated scoring

llm-regtest

Lightweight regression testing for LLM prompts

llm-reka

Access Reka models via the Reka API

llm-relay

Unified LLM usage management — API proxy, session diagnostics, multi-CLI orchestration.

llm-release-governor

Promotion gate for LLM deployments. Blocks unsafe CI to staging promotion.

llm-release-notes

使用大语言模型根据 git 差异文件生成变更日志的工具

llm-rename

An `llm` plugin to assist with renameutils qcp/qmv commands.

llm-repeator-redis

LLM tools for repeated generation

llm-repl

A REPL for ChatGPT

llm-replicate

LLM plugin for models hosted on Replicate

llm-req

llm req client

llm-requesty

LLM plugin for models hosted by requesty

llm-research

A minimum Python package built on top of the LangChain framework to interact with LLM.

llm-research-wiki

Typed LLM wiki graph pipeline for research and development projects

llm-researcher

LLM plugin for comprehensive research using Jina AI's Search Foundation APIs

llm-resource-finder

A new package that helps users discover and access the latest free LLM (Large Language Model) resources. Users can input their specific needs or interests, and the package will return a structured lis

llm-resource-planner

CLI tool to estimate VRAM requirements and GPU fit for Hugging Face LLMs without downloading model weights

llm-response

llm-response-cache

SQLite-backed LLM response cache. Exact match + fuzzy match. Decorator API. Zero mandatory server dependencies.

llm-response-schema-lite-py

Tiny schema validator for structured LLM responses. Python port of @mukundakatta/llm-response-schema-lite.

llm-response-validator

Validate LLM responses against schemas, types, and constraints. Catch bad JSON, missing fields, and hallucinated formats before they crash your app.

llm-retry-py

Exponential backoff with full jitter for LLM API calls. Sync + async. Built-in retryable-code presets for Anthropic, OpenAI, Bedrock, Gemini. Zero runtime deps.

llm-review

A local LLM-powered code review CLI tool

llm-rewards

Lean, modular reward functions for RL training with LLMs

llm-rewind

Time-travel debugger for AI agents. Record any production run, replay any failure.

llm-ripper

A production framework for modular deconstruction, analysis, and recomposition of knowledge in Transformer-based language models

llm-roleplay

LLM Roleplay: Simulating Human-Chatbot Interaction

llm-rosetta

LLM-Rosetta: Unified LLM API adapter — bidirectional conversion between OpenAI, Anthropic, and Google formats via intermediate representation (IR).

llm-rotate

Unified LLM client with key rotation, health-aware failover, and multi-provider orchestration.

llm-rotator

Fault-tolerant LLM provider rotation with circuit breaker, quotas, and model-first routing

llm-route

Intelligent LLM routing with weighted least-outstanding selection, 429 cooldown, and request class isolation

llm-router

Quick LLM routing using Embeddings

llm-router-ledger

Route text and embedding calls across LLM providers, keeping a JSONL ledger of every request and response for offline cost reconciliation.

llm-routing

Multi-LLM router MCP server — smart complexity routing, budget-aware model selection, 20+ providers (Claude, OpenAI, Gemini, Ollama, etc.)

llm-rovodev

LLM plugin exposing the RovoDev model for the llm CLI

llm-rpc

A Python package for LLM RPC operations

llm-rs

Unofficial python bindings for llm-rs. 🐍❤️🦀

llm-rs-cuda

Unofficial python bindings for llm-rs.

llm-rs-metal

Unofficial python bindings for llm-rs. 🐍❤️🦀

Python agents — page 437 of 565

Browse other language pages