Python agents

Microlib for converting LLM weights into sepweight format

An LLM inference solution to quickly deploy productive LLM service

A package to perform LLM inference in Solenium/Unergy HQ

A zero-configuration tool to automate web-based LLM interactions.

A Language Model Enhanced Command Line Interface

Safety and guardrails toolkit for LLM applications

Provider and client helpers for signed LLM transcript verification

Add your description here

The SimilarityChecker module determines the similarity between two items.

SIREN: lightweight, plug-and-play guard models reading LLM internal representations, for harmful content and for agent trajectories.

Probe → Plan → Load. Universal model loader for multi-GPU LLM deployment.

Multi-provider AI chat interface supporting 9+ LLM providers (Anthropic, OpenAI, xAI, Cohere, Mistral, Perplexity, Gemini, HuggingFace, Groq)

輕量級 LLM 模型追蹤與自動替換 Decorator

Intelligent tool routing for LLMs with 95.8% reduction in context size

Smart memory management for LLM conversations - topic-aware compression that just works

SmolLM2-135M-Instruct.Q4_1 for LLM

LLM Sniffer - OpenAI-compatible reverse proxy with request/response inspector

Snow Globe multi-agent system for open-ended wargames with large language models

LLM-driven agent-based information diffusion simulation

LLM plugin for semantic sorting

A Python library that uses LLMs as comparators for semantic sorting.

A Python wrapper for managing OpenAI API and other LLM models.

Benchmark any LLM on any hardware. CLI for the llm-speed.com flywheel.

Track, visualize, and optimize LLM API spending. Two lines of code, zero config.

Track and limit LLM API spending in real-time. Drop-in middleware for OpenAI, Anthropic, Google, and any OpenAI-compatible API.

Utility to generate ChatGPT prompts for SQL writing, offering table structure snapshots and sample row data from Postgres and sqlite databases.

Generate Data from LLM easily using LLMKit

A comprehensive LLM tracing and monitoring library

Agent framework with tool calling for OpenAI, Anthropic, and Google

Python library for standardization, optimization and monitoring of LLM API calls

Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steer vectors

Streaming keyword guard for LLM output.

Real-time parser for LLM streaming responses with tag-based content extraction

A callback-driven, prefix-safe, lazy LLM stream sanitization library.

A brief description of my package

An llm plugin to add structured JSON output support to LLMs

Extract per-field confidence scores from LLM structured JSON outputs using token-level log-probabilities.

Constrain LLM generation to structured output, such as function calling and tool use

一个简单的HTTP客户端库，用于与结构化输出API交互

This package would process text input, such as a research paper title or abstract snippet, and generate a structured summary of the core idea or problem addressed. It uses an LLM to interpret the inpu

Practical tools for large language model study

Advanced subtitle translator with LLM support for converting SRT to bilingual ASS files using OpenAI, Gemini, or DeepSeek APIs

Universal tools for prompt engineering and LLM interactions.

Use an LLM to summarize paragraphs.

LLM Switch Module - 一個用於切換不同 LLM 提供商的模組

A provider-agnostic Python interface for routing generation calls across LiteLLM, OpenAI, Ollama, and Watsonx

Lightweight taint tracking for LLM pipelines — label secrets at entry, block them at unsafe sinks

LLM-to-LLM interview framework for evaluating conversational capabilities

lightweight library for building Trigger-Action programs with llm

A collection of preset efficient prompts packaged into LLM agents.

LLM Task Handler

A lightweight Python library for creating tasks and workflows with Large Language Models (LLMs) using prompt templates.

LLM plugin to interact with Tavily API

Call LLM as easily as calling a taxi.

Add your description here

A standardized, file-based telemetry toolkit for LLM Agents.

Pass text through a chain of 20 LLM translations and watch the meaning drift

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

Load LLM templates from Fabric

Load LLM templates from local paths and cloud storage (S3, GCS, Azure) using any supported fsspec URL scheme.

Laod LLM templates from GitHub repositories

LLM template loader for Latitude - Load prompts from Latitude as LLM templates

Load LLM templates from SourceHut repositories

A simple CLI to chat with LLM Models

A terminal-based UI for LLMs with PydanticAI and MCP integration

Deterministic testing framework for LLM-powered apps — record/replay cassettes, eval scoring, regression testing

A package for generating code using various AI models.

Professional-grade LLM evaluation framework with ZENO-style HTML reports and enhanced sample analysis

Comprehensive testing suite for LLM evaluation: hallucination detection, consistency, robustness, safety, and multi-language code generation assessment.

Remove characters from text while keeping it understandable for LLMs, saving on inference costs.

Run large language models.

A lightweight, rule-based text splitter for LLM context window management, handles multiple file formats and enriches chunks with metadata.

A placeholder package for LLM The Game

Token-bucket rate limiter for LLM API calls with per-model limits

Token-efficient code analysis for LLMs. 5-layer stack: AST, Call Graph, CFG, DFG, PDG. 95% token savings. 17 languages.

LLM fragment & template loaders for tmux scrollback and helpful prompt templates

simple llm based tools to access from cli

Large language model to corpus

Tiny wrapper exposing Prompture helpers to convert LLM output into JSON.

A robust integration engine that enhances communication between LLMs and MCP servers/functions with validation, retries, and safety.

Tiny wrapper exposing Prompture helpers to convert LLM output into TOON.

A todo application MCP server designed for AI agent task management

llm together plugin

LLM plugin for models hosted by Together AI

Pre-call cost estimation, tracking, and budgets for OpenAI, Gemini, and Claude

Token cost control and auto-optimization for LLM apps — compress prompts, estimate costs, enforce budgets, route to cheap models, and cut LLM spend by up to 60%

Cut your LLM API bill by 30-70% with zero accuracy loss

A package to track LLM token usage in context

A lightweight Python library for tracking OpenAI and Anthropic SDK costs with budget alerts

Tokenizer utilities for LLM inference

LLM tokenizers tools

Multi-provider token analysis toolkit for LLMs

Open benchmark of LLM tokenization across 5 providers — offline vs empirical calibration deltas.

Profile your LLM payloads. Find the waste. Cut the cost.

Lightweight drop-in Python decorator to track costs, monitor token usage, and enforce budget/rate limits for LLM API calls