Python agents

A DSL-based LLM workflow engine that supports multi-model collaboration, dependency management, and result aggregation

Serving files for hungry LLMs

Config-driven, YAML-first open-source LLM training platform

Small CLI playground for Qwen via an OpenAI-compatible LLM Forge gateway.

Minimal llm_formats package exposing a single public function

A configurable forwarder for OpenAI-compatible LLM requests

LLM Foundation Tools

LLM Foundry

Load files from a local directory as fragments

Load documents as fragments

LLM plugin to load entire folder contents as fragments

Load GitHub repository contents as LLM fragments

LLM plugin for pulling Go package docs

LLM fragment loader which converts various formats to Markdown.

Use PyMuPDF to insert PDFs as markdown

Run URLs through the pure.md API

LLM fragments plugin for PyPI packages metadata

Run URLs through the Jina Reader API

A plugin for llm to load Reddit threads as fragments

Load repository contents as LLM fragments using Repomix

LLM plugin for pulling Rust crate docs

Run URLs through the Trafilatura to get plain text

Load SourceHut repository contents as LLM fragments

LLM fragment loader for Python symbols

llm plugins for loading tmux panes

Load bills from Congress.gov as LLM fragments

LLM plugin for loading YouTube subtitles as fragments

Fetch youtube transcripts and convert them into plaintext for llm consumption.

LLM Fragment Loader for pulling ticket conversations from Zoho Desk

Production-ready filesystem access tools for LLMs with TOCTOU protection

Finite State Machines for Large Language Models

Llm function is a decorator that uses llm to assemble reusable workflows from available tools to match input and output models.

Minimal metadata and discovery helpers for typed Python tools used by llm_function runtimes.

A lightweight Python library for creating reliable, contract-driven LLM functions whose core logic is implemented by an LLM.

Build semantic functions.

LLM-powered automated fuzzing tool for Python functions

This is LLM Gateway package

LLM plugin for Google Cloud Vertex AI models including Gemini and Model Garden

LLM plugin to access Google's Gemini family of models

LLM plugin to access Google's Gemini via Code Assist API with OAuth

LLM plugin to access Google's Gemini family of models, with support for YouTube URLs

Agent framework with learning capabilities

Run models distributed as GGUF files

LLM plugin to generate GitHub PR titles/bodies and create PRs using the 'gh' CLI.

AI-powered Git commands for the LLM CLI tool

LLM plugin to generate git commit messages and interactively commit.

Intelligent Git Commit Tool with LLM Integration

GitHub Copilot plugin for LLM CLI tool

LLM plugin to access GitHub Models API

LLM testing framework for validating agent behavior and tool usage

Plugin for LLM adding support for GPT4ALL models

One GPU. Full LLM workflow. Real benchmarks. No cloud required.

LLM ベースのエージェントのワークフローをグラフ形式で記述・実行する軽量ライブラリ

A plugin to add support for the GreenPT AI inference service to llm

LLM plugin for filtering text using semantic regular expressions

CLI for benchmarking LLM inference servers (vLLM, SGLang, llama.cpp)

LLM plugin providing access to Grok models using the xAI API

Transcribe audio using the Groq.com Whisper API

LLM-Guard is a comprehensive tool designed to fortify the security of Large Language Models (LLMs). By offering sanitization, detection of harmful language, prevention of data leakage, and resistance against prompt injection attacks, LLM-Guard ensures that your interactions with LLMs remain safe and secure.

v0.66.0: sycophancy_score() direction corrected — AUROC 0.9296 [0.8754, 0.9703] on Perez 2022 (was 0.0704, wrong direction). AgentShield judge_risk field fix.

LLM Guard — PII 탐지 및 프롬프트 인젝션 차단 라이브러리

AI safety guardrail — intent analysis, prompt injection detection, and policy enforcement for LLM applications

A package for LLM guardrails

LLM plugin for pulling content from Hacker News

A unified handler for LLM API calls across OpenAI, Anthropic, and Google

Effortlessly run LLM backends, APIs, frontends, and services with one command.

Lightweight AI agent infrastructure — harness orchestrates, backends execute

LLM Agent experimentation harness for SWE tasks

LLM utilities and tools

A helper package to work with LLMs

LLM Hippocampus — a Context Engineering playground

Plugin for LLM adding models hosted on AI Horde

OpenAI-compatible inference server: Llama 3.1 8B + Whisper + Kokoro TTS exposed via ngrok

LLM-optimized HTML cleaning: hydration extraction, token budgets, multiple output formats

HTTP API for LLM with OpenAI compatibility

This Python SDK that provides convenient clients for interacting with the LLM-HUB – a centralized backend service

LLM plugin providing access to the huggingface inference API

LLM plugin to access Hugging Face models

CLI-based threat hunting platform using LLM and RAG for semantic search of security logs

a data preprocessing toolkit that makes it easy to create common LLM-related data structures; from training data to chain payloads!

Access hyperbee.ai models via API

LLM access to Hyperbolic's API

LLM plugin for iaedu.pt API — no adapter required

CLI tool for managing LLM IDE prompts and rules

A comprehensive toolkit that provides building blocks for LLM-based named entity recognition, attribute extraction, and relation extraction pipelines.

Ferramenta de suporte para treinamentoe análise de modelo de classificação de imagem com assistente virtual integrado

Production-grade async image preprocessing for LLM APIs

LLM-based image categorization tool with focus on book cover detection

A lightweight framework that connects LLMs to a virtual computer (Docker-based sandbox) to build general-purpose agents

Run prompts against LLMs hosted by Inception Labs with diffusing animation

A readable LLM inference server implementing paged attention and continuous batching

Large Language Models Inference API and Applications

LLM plugin for models hosted by Inference

LLM inferencing utilities for multiple projects.

Pluggable LLM inference routing SDK — bring any model from any provider

A collection of commonly used code