PyPI agents

A plugin to add support for the GreenPT AI inference service to llm

LLM plugin for filtering text using semantic regular expressions

CLI for benchmarking LLM inference servers (vLLM, SGLang, llama.cpp)

LLM plugin providing access to Grok models using the xAI API

Transcribe audio using the Groq.com Whisper API

LLM-Guard is a comprehensive tool designed to fortify the security of Large Language Models (LLMs). By offering sanitization, detection of harmful language, prevention of data leakage, and resistance against prompt injection attacks, LLM-Guard ensures that your interactions with LLMs remain safe and secure.

v0.66.0: sycophancy_score() direction corrected — AUROC 0.9296 [0.8754, 0.9703] on Perez 2022 (was 0.0704, wrong direction). AgentShield judge_risk field fix.

LLM Guard — PII 탐지 및 프롬프트 인젝션 차단 라이브러리

AI safety guardrail — intent analysis, prompt injection detection, and policy enforcement for LLM applications

A package for LLM guardrails

LLM plugin for pulling content from Hacker News

A unified handler for LLM API calls across OpenAI, Anthropic, and Google

Effortlessly run LLM backends, APIs, frontends, and services with one command.

Lightweight AI agent infrastructure — harness orchestrates, backends execute

LLM Agent experimentation harness for SWE tasks

LLM utilities and tools

A helper package to work with LLMs

LLM Hippocampus — a Context Engineering playground

Plugin for LLM adding models hosted on AI Horde

OpenAI-compatible inference server: Llama 3.1 8B + Whisper + Kokoro TTS exposed via ngrok

LLM-optimized HTML cleaning: hydration extraction, token budgets, multiple output formats

HTTP API for LLM with OpenAI compatibility

This Python SDK that provides convenient clients for interacting with the LLM-HUB – a centralized backend service

LLM plugin providing access to the huggingface inference API

LLM plugin to access Hugging Face models

CLI-based threat hunting platform using LLM and RAG for semantic search of security logs

a data preprocessing toolkit that makes it easy to create common LLM-related data structures; from training data to chain payloads!

Access hyperbee.ai models via API

LLM access to Hyperbolic's API

LLM plugin for iaedu.pt API — no adapter required

CLI tool for managing LLM IDE prompts and rules

A comprehensive toolkit that provides building blocks for LLM-based named entity recognition, attribute extraction, and relation extraction pipelines.

Ferramenta de suporte para treinamentoe análise de modelo de classificação de imagem com assistente virtual integrado

Production-grade async image preprocessing for LLM APIs

LLM-based image categorization tool with focus on book cover detection

A lightweight framework that connects LLMs to a virtual computer (Docker-based sandbox) to build general-purpose agents

Run prompts against LLMs hosted by Inception Labs with diffusing animation

A readable LLM inference server implementing paged attention and continuous batching

Large Language Models Inference API and Applications

LLM plugin for models hosted by Inference

LLM inferencing utilities for multiple projects.

Pluggable LLM inference routing SDK — bring any model from any provider

A collection of commonly used code

Project: Machine Learning for Trading and Portfolio Management (ENSAE)

Drop-in prompt injection defense for LLM apps and AI agents — detect, sanitize, block, and audit injection attacks in real time. Includes multi-turn session scanning, allow-lists, rate-abuse detection, multi-layer scanner, FastAPI and Flask middleware.

Deterministic Unicode-aware input hardening for LLM applications.

A package for sanitizing and securing user inputs to LLMs

A comprehensive toolkit for LLM evaluation, prompt engineering, fine-tuning, and inference optimization

A Python Library to download all the required LLM Python packages for building an LLM-based chatbot

A high-performance instrumentation framework for capturing, streaming, and analyzing internal activations of large language models

LLM Integrity → This package is now `aiir`. Install: pip install aiir

Async multi-provider LLM client with typed tool calling, lazy output parsing, and Azure/Databricks/OpenRouter/LiteLLM/DeepSeek/local backends

A proxy server to intercept and store LLM API calls for fine-tuning dataset collection

Intercept and analyze LLM traffic from AI coding tools

A flexible interface for working with various LLM providers

LLM plugin for interpolating between embeddings

Candidate CLI for submitting LLM interview history.

A Python library for managing multi-agent model invocation with automatic failover strategies

A lightweight Model I/O normalization layer for OpenAI-compatible LLM calls.

A jailbreak package which integration some open manners

LLM plugin for Jina AI

Access Jina AI embeddings via their API

LLM plugin for pulling content from Jina Reader API

Fuzzy join pandas DataFrames using LLM scoring and embedding retrieval — record linkage, entity resolution, approximate join

Write and execute jq programs with the help of LLM

A JSON library wrapper that gracefully handles markdown-wrapped JSON from LLMs.

使用 LLM 修正 json 文件

A simple utility to fix malformed JSON from LLM outputs

Production-safe JSON repair and schema validation for LLM outputs

Robust JSON parsing for LLM outputs with automatic repair and field extraction

A unified interface for streaming structured JSON from OpenAI, Anthropic, and Google Gemini.

Fast, minimal JSON repair implemented in Rust (PyO3), focusing on truncation and trailing comma fixes.

A Python package for converting unstructured text into JSONL format using LLMs.

llm's judge each other

Run a IPython interpreter in the LLM virtual environment

A multi-model LLM evaluation framework with consensus-based aggregation for RAG, summarization, and agentic AI workflows

Confidence-driven escalation middleware for classifier edge cases

CLI knowledge base manager for markdown wikis, designed for both humans and LLM agents

One tiny model, every LLM API. Drop-in test server for OpenAI, Anthropic, Bedrock, and Vertex.

Framework for collecting and managing LLM context

Free-tier LLM API key pool with rotation, cooldown, and LangChain drop-in

A pythonic way to call llms & implement llm algorithms.

A unified toolkit for working with multiple LLM providers

Tools to extract, visualize, and quantify latent knowledge in large language models

A plugin for LLM that adds tools to interact with a Go knowledge graph.

A minimal, notebook-first framework for running reproducible LLM experiments and comparing multiple models over JSONL/CSV datasets.

LLM Labeling UI is an open source project for large language model data labeling

LLM access to LAMBDA's API

Run prompts against LLMs hosted by https://lambdalabs.com/

An LLM tool plugin for using Latchkey to make authenticated HTTP API requests.

Personal LLM deployments made simple.

Load and dispatch individual transformer layers from HuggingFace model checkpoints

Stream transformer blocks layer-by-layer from disk to GPU with a pipelined prefetch queue (disk → CPU RAM → pinned RAM → GPU).

LLM Development Framework - Spec-driven development for AI-assisted engineering

Cost ceiling, audit log, and kill switch for LLM agents.