Python agents

Xpoz social media intelligence tools for LlamaIndex agents — Twitter/X, Instagram, Reddit, and TikTok

LlamaIndex VectorStore for MySQL 9's native VECTOR type — works with ShannonBase, self-hosted MySQL, and MySQL HeatWave.

Benchmark llama.cpp models across candidate configurations

Official Python SDK for LlamaGen Comic API and Animation API

TTTPS Proof-of-Time callback handler for LlamaIndex: cryptographic audit-trail timestamps for LLM events via the public KPP Provenance API

LlamaIndex web reader that loads URLs through ProxyHat residential proxies — rotation, geo-targeting, sticky sessions.

LlamaIndex tools and a mandatory pre-execution gate for RelayShield's MCP registry risk and prompt-injection breach checks.

LlamaIndex tools for U.CASH agent monetization over HTTP-402.

Benchmark the LLM inference capacity of a server (llama-benchy orchestrator with auto-detection, real-workload sizing, charts and reports).

Lightweight Python framework for building LLM agents with tool calling and RAG

A dev tool for manually driving llm-agents-from-scratch's SupervisedTaskHandler one call at a time, over HTTP, via a React frontend.

A resilient multi-provider LLM layer that automatically fails over to alternative models and providers when requests fail.

LaC (LLM as Code) - reference engine. Declarative behavior for LLM apps: law in files, perimeter in code.

Tamper-evident audit trails for LLM lifecycles: training, deployment, and monitoring.

Cross-vendor LLM quota / budget self-check CLI. Stable 0/1/2/3 exit-code contract lets any AI agent gate its work before burning through budget. Supports MiniMax Token Plan, OpenRouter credits, self-hosted LiteLLM proxy spend, and self-logged JSONL (any LLM vendor).

Cage: run local-LLM components in a network-isolated OS process, hardware access intact, with a friction-free call interface back to the rest of your app.

Free-first LLM routing for Python: local Ollama -> OpenRouter free models -> paid Anthropic API, with automatic fallback and a savings ledger.

Model names, pricing, and free-tier metadata for OpenAI, Anthropic, and Google Gemini.

LLM plugin to serve an OpenAI Chat Completions API endpoint

A tiny, readable circuit breaker for LLM calls: hard budget caps that fail over to a free local model instead of raising or overspending.

OpenRouter LLM benchmark for repair-agent and validator-agent model selection.

Multi-format LLM API compliance testing tool — validates endpoints against OpenAI Chat, Open Responses, Anthropic, and Google GenAI specs.

Fit chat history into any model's context window: token estimation, sliding-window packing with a running summary, and overflow detection. Zero dependencies, no AI inside.

Composable pre-call and post-call hooks for LLM API calls: pricing, budgets, cost caps, rate limits, event log, observability.

Pack the most important text into a fixed LLM context-window token budget.

Dequantize compressed-tensors NVFP4 LLM checkpoints to dense safetensors (streaming, constant memory)

A lightweight Prometheus exporter for LLM eval metrics: faithfulness, semantic drift, cost, and CI/CD regression gating.

Accurate FLOPs, memory, latency, and energy estimation for Large Language Models.

Provider-agnostic middleware for LLM safety

The htop for LLM inference. Measured. Not guessed.

A multi-provider LLM-as-a-Judge consensus panel with chained criteria for concept matching validation.

Self-hosted LLM observability SDK for Python, LangChain, and LangGraph

Access tools from MCP servers as LLM tools

A personal, local-first memory store for LLM applications and agents

LLM plugin for the Meta AI API

Run-scoped LLM observability control plane backed by LiteLLM

Perplexity's Agent API as a model for Simon Willison's llm CLI.

Runtime prompt-injection defense middleware for LLM applications

Run multi-stage LLM workflows: DAGs of prompts and scripts with automatic output chaining

The pre-merge check for LLM model, prompt, schema, and provider changes

A GitHub Action and CLI that detects risky changes to LLM prompts and AI configuration before they ship to production

Resilient cascading LLM inference across multiple providers with failover, circuit breaking, and retry cooldowns

Client-side rate limiting for the Claude API. Never sees your API key.

Transparent local proxy that redacts private information from LLM requests and seamlessly restores it in responses

Cost-aware, latency-optimized routing for multiple LLM API providers

Flight recorder for LLM agents: trace every call, replay runs deterministically, diff runs to find where behavior diverged.

Zero-dependency scrubbers for LLM chat output — strip leaked JSON state-op fences, backend scaffold blocks, and tool-preamble meta-narration from player-facing text

Defensive pipeline for LLM apps: prompt injection, tool-call gating, output/PII guards

Streaming privacy gateway for configurable PII transformation and OpenAI-compatible proxy traffic.

Count distinct LLM users and find top token consumers across services, days and tools. Fast, small, portable summaries in Go and Python.

Local smoke tests for live LLM models, latency, and cost

Track LLM token usage, enforce policies & budget limits, and trigger alerts — across OpenAI, Groq, OpenRouter, AWS Bedrock, and custom providers.

Per-query token ledger for LLM pipelines: record what the API reports, answer with one GROUP BY. Zero dependencies, dashboard included.

Local LLM token efficiency middleware — zero cloud, zero tracking, coaches developers on token waste in the terminal

Track LLM API costs, tokens, and latency to MySQL

LLM plugin for models hosted by UnoRouter

Lightweight terminal tool to check remaining credits / quota across LLM providers. Zero dependencies.

A general-purpose LLM verification framework: fine-grained reward + Pivot Preference Tournament best-of-N selection.

Async LLM router across AWS Bedrock, Google Gemini, and Groq providers

Deterministic workflow topology enforcement for LLM-powered systems.

LLM plugin for Z.AI / GLM models with Coding Plan support

LLM plugin for Z.AI / GLM models with Coding Plan support

LLM plugin for ZenMux.ai - OpenAI Chat Completions + Anthropic Messages API

Interactive LLM-driven automated algorithm design with evolutionary optimization

LLM-driven interactive hypothesis generation for SMEFT global fits

A lightweight, personal Claude Code-style agentic CLI for LOCAL LLMs (LM Studio).

Compose a language model from scratch — and learn how it works. PySide6 educational GUI + CLI.

Retired: its commands moved to llmsurgery and aai-coding

LLM Firewall: a safety layer between your application and any LLM API — input/output firewalling, PII redaction, jailbreak detection, and domain-specific guardrails.

A lightweight Python decorator for caching, rate limiting, and retrying LLM API calls.

A minimal, ergonomic Python library for interacting with LLMs

LLMIntent suite: Anatomy of any weighted LLM, fly-connectome prior, trajectory, MisAlign Flag, isolates, IV, latent inspect

Local, folder-first LLM knowledge bases: format spec, CLI, MCP server, and agent skills.

Python library to support LLM testing.

LLM-based ranking and reasoning algorithms for search and recommendation

Intelligent routing, load balancing, and failover for LLM providers

LLM Runner Control is a CLI tool to interact with local and remote LLM, define multiple scenario variations (model × prompt × options), run it over a dataset and capture structured results for comparison or to build knowledge through meta analysis.

Paquete que permite trabajar con los Grandes Modelos de Lenguaje (LLM, por sus siglas en inglés) y los Grafos de Conocimiento (KG, por sus siglas en inglés)

Mirror official docs (via llms.txt) as plain Markdown for LLM ingestion and RAG.

Generate and validate llms.txt files — CLI and Python library, zero dependencies.

Unified interface to call OpenAI and Anthropic-compatible LLM APIs from Python

Python SDK for LLMSafeSpaces API

Zero-dependency, cross-platform LLM/GEO/AEO checker CLI. 21 checks, pure Python stdlib, no runtime dependencies.

LLM Surgery

A production-ready routing, fallback, and rate-limiting client for OpenAI-compatible LLM endpoints.

Find, download (over BitTorrent + webseeds), and SHA-256-verify LLM models from the LLM Torrents catalog.

Profile LLM gateway logs for prefix-cache reuse potential, and export anonymized replayable traces

Identifiers designed to survive being read, copied and re-emitted by language models

Passive LLM endpoint identity and stability instrumentation

Serve existing Markdown, Obsidian-style, or LLMWiki folders as cited agent-readable context.

MCP server providing agent capabilities for LM Studio: file I/O, terminal execution, web search, persistent memory, and skill loading.

Shared AWS Bedrock internals (SigV4 signing, event-stream decoding, Anthropic pricing) for lmux

A local-first AI orchestration framework

CLI tool to manage local LLM models and role-based server lifecycle

RAG Knowledge MCP Server — FastMCP + LanceDB + Hybrid Search

Localstorage for python with more tools

Use the OpenAI Python SDK with your own ChatGPT subscription

Deterministic package-map inference engine for Logion.

LoomEye HPC Agent — connect your cluster to LoomEye

loopy-agent: 21 Essential AI Concepts in one toolkit — agentic loops, gateway, guardrails, evals, caching, observability, MCP, multi-agent, middleware, plugins, state, safety, cost, drift, skills, verification, audit, streaming, multi-modal, compliance, and explainability.