Language
Python agents
56,457 Python AI agents indexed on MeshKore — the most complete public catalog, ranked by popularity and updated daily.
56,457 agents · ranked by popularity · refine in the directory →
Python agents — page 436 of 565
A LLM Memory Cache package
Estimate LLM VRAM usage (weights/KV/activations) and recommend tp/dp/sp configs.
Personal conversation knowledge base: import, search, and analyze conversations from ChatGPT, Claude, Gemini, and Claude Code
A memory management system for large language models
Currently for internal use only.
Stable canonical sha256 hash of LLM request/message structures. Recursive key-sorted JSON canonicalization with per-provider presets that drop noise fields. For cache keys and idempotency. Zero runtime deps.
A helper library for estimating tokens used by messages.
A tool for harvesting metadata from dataset landing pages using Large Language Models.
Accurate LLM usage & cost tracking for Python backends (FastAPI-native)
A lightweight evaluation framework for large language model outputs
Official implementation of the LLM-Microscope package functions for the paper
LLM MIME types
Generates LLM context by scraping and summarizing documentation for Python libraries listed in a requirements.txt file.
A framework to glue all your AI tools together
LLM plugin for accessing MiniMax models via their API
LLM plugin providing access to Mistral models using the Mistral API
LLM plugin for running models using MLC
Support for MLX models in LLM
pytest plugin to mock and replay OpenAI and Anthropic API calls — record once, replay forever, no API key needed
Mock LLMs' responses for unit-tests
Standalone model alias resolver
A package to calculate token costs for LLM models
Track and check deprecation status of LLM provider models (OpenAI, Anthropic, etc.)
Compare LLM model outputs side-by-side with rich diff visualization
Filter llm models list by starring favorites
OpenAI-compatible API server for simonw's llm cli
Intelligent multi-LLM request router for cost optimization
A CLI tool to list available LLM models from various providers
📈 Monitor your LLM integration with Galileo's LLM Monitor!
Lightweight SDK for LLM cost & latency monitoring
A small example package
Run prompts against LLMs hosted by Moonshot
Plugin for LLM adding support for the MPT-30B language model
Map-reduce spreadsheet operations powered by LLM prompts
Chat with Mr Chatterbox
A plugin for LLM that combines file bundling and LLM mapping capabilities
A Python library for using Large Language Models (LLMs) to fill out multiple-choice questionnaires about chat conversations.
LLM API for multiple model providers
Mutation testing for LLM prompts. Find the gaps in your eval suite before production does.
Deterministic VM for LLM program execution
Advanced system information tool for local LLM usage
Schema-driven Named Entity Recognition powered by local LLMs via Ollama
Use an LLM to run inference, for NER (named entity recognition) and/or NEL (named entity linking). Build a knowledge graph. Evaluate results.
A plugin to add support for the Neuralwatt AI inference service to llm
A unified interface for multiple language model providers
Create embeddings using the Nomic API
LLM plugin for models hosted by NOS Cloud
Karpathy-style LLM wiki from your Claude Code, Codex CLI, Cursor, and Obsidian sessions
Access Nous Research models via API
A tool for obfuscating text by manipulating token IDs while preserving token count and structure
Lightweight SDK for LLM inference logging and observability
Context0 SDK — one import, all calls logged
OpenAI-compatible LLM proxy with SQLite request capture, observability, and an admin UI.
LLM plugin providing access to models running on an Ollama server
OneSDK is a Python library that provides a unified interface for interacting with various Large Language Model (LLM) providers.
Conditionally serve content to LLM crawlers in Python web frameworks.
Access OpenAI models via a Codex subscription
LLM plugin for OpenAI and Google image generation and editing
LLM plugin for OpenAI
Access OpenAI models via a Codex subscription
LLM plugin to access OpenHands Cloud API
LLM plugin for models hosted by OpenRouter
Add your description here
A placeholder package for llm-oracle
Multi-agent LLM communication system with ensemble orchestration
An open-source chatgpt tool ecosystem where you can combine tools with chatgpt and use natural language to do anything.
Drop-in OpenTelemetry GenAI observability for any LLM backend — local or cloud.
Validate LLM outputs against schemas with automatic retry and JSON extraction.
Extract and parse JSON from unstructured text outputs from LLMs
Sanitize LLM outputs before HTML, SQL, shell, or markdown sinks. Python port of @mukundakatta/llm-output-sanitizer.
Plugin for LLM adding support for Google's PaLM 2 model
A library to parametrize multiple API calls for LLMs
Multi-agent debate for better AI decisions. Research-backed, local-first.
Parse data from documents optimised for downstream llm tasks.
A simple JSON parsing tool that preprocesses and parses JSON strings.
Microlib for partial deployment of LLMs
Real-time chat between multiple LLMs with human moderator ability
LLM Patch Driver is a framework for patching data objects using LLMs. It can generate and apply a single patch, or start the patching loop to fix complex validation issues.
Robust search/replace file editing for LLM-driven code changes
A tool for tracing LLM requests
Transform enrichment outputs into verifiable, auditable pathway claims with calibrated abstention.
Talk to your PDFs using an LLM.
LLM-friendly PDF splitter & image optimizer. Chunk PDFs by size and downsample images for RAG/Bedrock.
LLM fragment plugin to load a PDF as a sequence of images
Security testing toolkit for LLM-based systems
Tool for monitoring LLM inference metrics
Benchmark the performance (output speed, latency) of OpenAI compatible endpoints
LLM access to pplx-api 3 by Perplexity Labs
PostgreSQL pgvector storage backend for LLM
A modular, async, composable AI pipeline library for building conversational agents and content processing pipelines
LLM serving platform
Production-ready LLM platform building blocks — observability, prompts, eval, RAG, hallucination guards
ocr library
a tool that queries LLMs, analyzes responses, and executes experimental pipelines