Python agents

A library for evaluating Language Models using Knowledge Graphs

A library for evaluating Language Models using Knowledge Graphs

A knowledge graph generator using LLMs.

A chain message bot based on OpenAI

Unified LLM API client (placeholder)

Production-grade LLM client for Python - 100+ providers, 11,000+ models. Rust-powered.

Unified LLM API client (placeholder)

AI API gateway SDK with cost tracking, budget enforcement, and multi-provider routing for LLM applications

Unified LLM testing lab - test, compare, and interact with multiple AI providers through a single UI

Official Python SDK for the LLMLayer Search & Answer API

Security tool for detecting exposed LLM/AI API keys in public repositories

Portability lib for OpenAI, Hugging Face, and FastChat local model APIs

A simple library for making requests to LLMs

A Python library for interacting with Large Language Models (LLMs).

A backend for pydantic-AI agents and MCP servers.

Pydantic-AI based Multi-Agent Framework with YAML-based Agents, Teams, Workflows & Extended ACP / AGUI integration

Pydantic-AI models for AgentPool

LLMling provider based on the package 'llm'

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

LLMLink is a Python package that allows users to easily create LLM-powered Gradio applications

Add your description here

A library helps to chat with all kinds of LLMs consistently.

Loads a Langchain LLM by model name as a string.

High-performance columnar scan engine for LLM logs stored as JSONL

A Python package for manuscript management, designed to handle hierarchical structures of sections and subsections.

A unified interface for interacting with multiple LLMs and generative AIs.

A Shiny app to convert LLM Markdown exports to PDF with Quarto

A custom LLM-based git merge driver.

SDK for interfacing with core models hosted by LLM Solutions

A library designed to harness the diversity of thought by combining multiple LLMs.

AI pair programmer

Automatic cost tracking and observability for LLM applications

Automatic cost tracking and observability for LLM applications

Professional open source client for running large language models locally

Chaos engineering for LLM apps: mock OpenAI, Anthropic, Gemini and more, break them on demand, and get a verdict on your client's resilience.

An LLM-powered mock API server that dynamically generates realistic API responses based on OpenAPI/Swagger specifications.

Making agents cuter

LLM-powered bioinformatics pipeline generation from natural language

Compositional framework for LLMs

Observability and monitoring for AI apps

A library to talk to different language models

AI pipeline framework for Python.

Create a Python package.

Reduce LLM costs by 90% - AI recommendations with NO API keys needed!

Predictive resource-pressure instrumentation and runtime guardrails for systems processing untrusted inputs

Llmovoice python library

A test package for llm

Extract structured, LLM-ready content from any website — adaptive engine, no LLMs required

LLM-powered FFmpeg command assistant

A CLI tool for LLM performance testing

LLM-powered chart generation Python SDK — create charts with natural language

LLMPipeline is a Python package designed to optimize the performance of tasks related to Large Language Models (LLMs)

Versioned prompts and Agent Skills with progressive context loading for production LLM apps

A package for using llm models with api

LLM Package Manager — download, run, and share AI models from the command line

Large Language Models' pool management library

The Python library that lets you spin up any LLM with a single function. Route between local and remote LLMs with a unified interface.

Node execution agent for llm-port cluster-managed runtimes.

CLI installer and management tool for the llm.port platform

A package for calculating perplexity using various language models

Fast, offline-first LLM pricing lookup with auto-sync from LiteLLM data. Get token costs, context windows, and capabilities for 2500+ models.

Compare LLM API costs across providers from the command line

CLI tool to print directory structure and file contents for LLM context generation

A simple framework for LLM-powered applications

A Python package for creating and running LLM programs.

A unified framework for interacting with various LLM providers through a consistent interface with batch processing, templating, and rate limiting.

Static security scanner for LLM and agentic source code — finds prompt-injection, context-leak, PII, RAG, and agent-tool vulnerabilities before deployment.

A comprehensive LLM Prompt Management System

Version, compare, and manage your LLM prompts. No API keys required. Bring your own model.

A lightweight set of tools to use several llm and embeddings apis

OpenAI-compatible LLM reverse proxy with real-time conversation analytics

Easily interact with all main LLMs

Automatically generated LLM models for llmpy-lib

todo

LLM Quality Gate - A provider-agnostic evaluation framework for LLM applications

A package for querying various LLM providers

LLMRails SDK

Intercept OpenAI inputs

A CLI tool to check if your local hardware can run a Hugging Face LLM.

Recommendation systems with LLMs from Shaped.ai

Prompt regression testing for RAG pipelines. Like git diff, but for AI.

A lightweight Python library providing easy access to popular LLM model names, metadata (context windows, capabilities, pricing tiers), and support definitions. Born from a failed experiment on context data compression for LLMs with finite context windows, this library helps developers manage model names, validate support, search by capabilities, and find models by requirements without hardcoding strings or maintaining spreadsheets.

Deterministic replay debugger for LLM agents

A package for building and managing tools for Large Language Models

轻量级的 LLM 响应格式化工具，支持标准响应和流式响应

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs

LLMRing public model registry CLI and tools (manual curation workflow)

LLMRing core server: alias sync, receipts, and usage logging (key-scoped, no users)

A professional Git-based Skill management library for LLM agents.

A unified framework for LLM routing and evaluation.

LLM Stack Python SDK

LlmRush: A Python package for training and Inference language models

A unified interface for multiple LLM providers

MCP server to bridge LLM calls via Model Context Protocol

A simple example package