Python agents

Cross-LLM memory portability tool — user-owned context vault across Claude, ChatGPT, Gemini, and Ollama

Security analysis framework for LLM-generated content in software development

A command-line interface for language models

Easy to use LLM interface

A Flexible Framework for Accelerating LLMs Benchmarking

Read through cache for OpenAI's API.

High-performance document memory system with vector search capabilities for Python applications

llments

llmer is a lightweight Python library designed to streamline the development of applications leveraging large language models (LLMs). It provides high-level APIs and utilities for parallel processing, runtime management, file handling, and prompt generation, reducing the overhead of repetitive tasks.

HPE LLM Agentic Tool Mesh Platform is an innovative platform designed to streamline and enhance the use of AI in various applications. It serves as a central hub to orchestrate 'Intelligent Plugins,' optimizing AI interactions and processes.

Reserved name — lldesign: UI/Web/diagram design tooling for the FullSense LLM family. Reference implementation in development.

Reserved name — lleval: LLM eval framework for the FullSense LLM family (on-prem + cloud unified A/B, progressive size matrix, honest disclosure). Reference implementation in development.

Self-evolving modular memory LLM framework — biological memory × formal verification × industrial IoT mesh × TUI HITL

llove — a cute, terminal-first Artifact for inspecting LLMesh data with llove

Reserved name — llrepr: typed Representation IR ("LLVM-for-expression") for the FullSense ecosystem. Reference implementation currently lives in llmesh as llmesh.llrepr.

Reserved name — lltrade: trading research for the FullSense LLM family (PAPER-TRADING ONLY, v0.x). Reference implementation in development.

Secure LLM Mesh over MCP — multi-LLM swarm + industrial IoT + privacy gateway

A less pager that uses LLMs to hallucinate infinite file continuations

A lightweight, cross-platform latency and throughput profiler for LLMs

A metrics and evaluation library for LLMs

Python SDK for the evaluate LLM evaluation framework

LLM evaluation, hallucination detection, AI content detection, compliance, document parsing, governance, security, observability, ground truth testing, conversation evaluation, red team testing, and anomaly detection. 78 metrics across 13 modules. Works with or without API.

Eval

Execute LLM-Generated Python Code Automatically

llmexport: A toolkit to export llm to onnx or mnn.

A library to extract structured information from unstructured text using LLMs, powered by LangChain.

Financial Data Assistant - A PocketFlow-based LLM library for financial data chat with tool calling

In-process LLM client faker that patches OpenAI, Anthropic, LiteLLM, and LangChain for fast, deterministic testing without network calls

It's a Python LLM package

A Python client for interacting with llamafile local LLM instances

Package to integrate feedback into LLMs

WIP

Hundreds of models & providers. One command to find what runs on your hardware.

Fleet-level batch dispatcher for LLM APIs. Pool requests across coroutines, route to provider Batch APIs, save 50% on cost without rewriting your agent loops.

A python package for developing AI applications with local LLMs.

Deploy /implement workflow templates for Claude and Gemini AI assistants

Deterministic LLM workflow engine

LLMFlows - Simple, Explicit and Transparent LLM Apps

CLI tool for running LLM batch processing jobs on HPC systems

Simple tool for formatting code for LLMs.

Automatically make the OpenAI tool JSON Schema, parsing call and constructing the result to the chat model.

Placeholder package to reserve the llmforge name

Format LLM language by using LALR(1) grammar. Supports JSON, XML, etc.

OpenAI-first hexagonal Python application scaffold for llmframe.

A filesystem-metaphor memory layer for LLMs and AI agents

llmfsd: LLM Fake Structured Data, faking Structured Data from any LLM

Dynamically generate JSON Schema from Python code.

Unified interface for multiple LLM providers

`LLMfy` is a framework for developing applications with large language models (LLMs).

Lightweight, provider-agnostic LLM calling library — OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock, Ollama

Semantic caching library for LLM and RAG systems

LLMGateway Python SDK Client

Protect OpenAI and Anthropic API calls from prompt injection, jailbreaks, and data-extraction attacks.

Create Google Calendar event URLs interactively from a natural language description, leveraging LLMs with an OpenAI Chat Completions-compatible API and user edits.

Effortlessly generate LLM APIs by simply defining input and output schemas.

An application framework for building LLM-powered applications.

Sync LLM agent configuration files (AGENTS.md, skills/) across different coding assistants

LLMGovernor — anomaly engine for LLM apps (core SDK with optional LiteLLM bundle)

A C++ AI engine with Python bindings

Open-source LLM evaluation framework — 50+ metrics for RAG, agents, safety, async eval, regression tracking, custom benchmarks, and exportable reports

Create knowledge graphs with LLMs

Plug-and-play LLM connector via YAML config

Open-source LLM prompt injection defense — protect any AI app in 2 lines of Python

大模型辅助函数库

Python library for interacting with Large Language Models.

Your Personal AI Cloud -- intelligent proxy, router, and cache for LLMs

Git blame for prompts: incident archaeology, git-native prompt versioning, and a no-SaaS production runtime for LLM workflows

Release engineering infrastructure for AI behavior - bundle, promote, evaluate, and replay agent behavior artifacts

LLMHub is a lightweight management platform designed to streamline working with LLMs.

LLMHub - Open-source multi-provider LLM gateway

A lightweight runtime for LLMHub that delegates to any-llm

LLMHub - Open-source multi-provider LLM gateway

light weight llm utilities for scalable AI apps

LLM-ify: create LLM-ready markdown and text from websites.

Library for replacing function calls with LLM inference.

Parse and match .llmignore files — the .gitignore for AI. Supports .cursorignore, .aiignore, .aiexclude, .claudeignore, .codeiumignore, .geminiignore, .aiderignore, .clineignore, .rooignore, .augmentignore, .copilotignore, .repomixignore.

Embed signed semantic-metadata layers into images, PDFs, and audio files

Where JavaScript, Python, and AI agents speak the same language

Document plugin system — charts, tables, presentations, export via MCP

Isolated Python code execution with resource limits

Document-knowledge MCP agents — full-text search, parsers, blob sync

Real-time pluggable dashboard with live widgets

Full-stack AI chat platform — multi-provider LLM, MCP tools, voice, budget

LLM execution engine — multi-provider streaming, MCP tools, and budget management

No-code pipeline automation — visual DAG builder with 112+ blocks

AI-native frontend development where AI builds, inspects, and operates real apps, dashboards, and tools

Llmint python library

Easily connect large language models into your application

MCP server for llmion — AI brand visibility monitoring & optimization

Core message and tool IR for LLM pipelines

A library to use Large Language Models (LLMs) as numerical optimizers

A code obfuscator to confuse LLMs

A package for evaluating language model outputs.