Python agents

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

RAG llm datatech

Placeholder package to reserve the llm-deep-bloom name on PyPI

LLM plugin of various deep research implementations

Access deepseek.com models via API

LLM access to DeepSeek's API

Yet another LLM access to DeepSeek's API

Model-agnostic LLM output degeneration detector — 4-signal composite scoring in a single pass

MCP server for multi-LLM deliberation with anonymized peer review

Minimal Python package: llm_dep_extractor

Transparent, probabilistic classification of text as human-generated or LLM-generated

LLM plugin to access Devin API

LLM development debug layer - every API call recorded, nothing lost. Reasoning tokens, prompt diff, session timeline, LangChain/LlamaIndex integration.

LLM plugin to create a hierarchical summary description of a project

A minimal, auditable Python library for calling multiple LLM providers. Lightweight LiteLLM alternative.

A Python package for managing LLM chat conversation history

Deterministic codebase context retrieval for LLMs

A CLI tool for comparing LLM outputs — semantically, visually, and at scale

LLM plugin for models hosted by DigitalOcean AI

A light-weight Python library 🐍 for deploying DAG chains of customizable Large Language Model operations. Leveraging the asyncio framework, LLM-Director allows developers to create, manage, and orchestrate actions and processes in an efficient and scalable manner. With its unique structure and integration with FastAPI, LLM-Director offes a robust solution for building applications, API endpoints, and workflow automation systems.

LLM Discord Bot

LLM model discovery and tracking system for real-time monitoring of available models across multiple providers

Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics

Knowledge Distillation for Large Language Models

Model distiller automator — recursively drives an LLM with seed prompts and stores compressed outputs in SQLite

Extract LLM DNA vectors — low-dimensional representations that capture functional behavior and model evolution.

AI-powered documentation generator for code projects

Ask questions of LLM documentation using LLM

Generate Python docstrings automatically with LLM and syntax trees.

Code to generate docstrings for Python code using GPT-4 etc.

A Python library for LLM-powered document analysis and processing

LLM integrations for DocumentCloud

A modular, block-by-block LLM building library

Production-grade LLM output validation package. Validates LLM outputs using your own LLM when needed — and no LLM when not.

Local-first semantic drift detection for LLM outputs.

llm plugin for dspy

LLM plugin for Duckduckgo AI Chat service

Debug plugin for LLM

Carbon-aware scheduling and telemetry for LLM applications

Add your description here

Use LLM to edit source files

A CLI tool to edit and chat with files using LLMs

Mathematical health monitor for LLMs — detect degradation and hallucination without NLP

[IMPORTANT: This library is now part of LangChain, follow its official documentation] A caching layer for LLMs that exploits Elasticsearch, fully compatible with LangChain caching, both for chat and embeddings models.

LLM plugin for models hosted by ElectronHub

LLM plugin providing access to the ELIZA chatbot

Send emails via macOS Mail.app — compose, draft, send with AppleScript

Embedding models from Gemini

Dummy llm plugin for demonstration purposes

Embedding models from Jina AI

Embedding models using Ollama pulled models

Run embedding models using ONNX

LLM plugin for embedding evaluation with semantic scoring

A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).

Durable, explainable long-term memory for the llm CLI, powered by Engram (Lumetra)

Create ensembles of Large Language Models to query them all at the same time.

A comprehensive evaluation toolkit for Large Language Models

Run evals against prompts using LLM

Drop-in observability for LLM applications — quality scoring, hallucination detection, cost tracking, and agent run debugging.

A project for evaluating reasoning capabilities in large language models (LLMs).

MCP server for agentic LLM evaluation: jury scoring, agent tracing via OpenTelemetry, document-grounded QA generation, PDF reports.

placeholder

A new package that processes news headlines or short text inputs to generate structured summaries of events, such as service disruptions or incidents. It uses an LLM to extract key details like the co

LLM + evolutionary algorithms to optimize programs in multiple languages and domains

LLM plugin for accessing Exa.ai API

LLM explains stack trace for all exceptions. It automatically takes your input code and the error and tries to give a solution.

LLM batch inference latency predictor and profiler CLI tool

Advanced Knowledge Graph Engine with Document Processing, Semantic Search and Multi-LLM Integration

LLM Expect is a minimalist, developer-first SDK for testing LLM-powered Python functions using structured JSONL datasets.

Tools that use LLM to explain datasets

A Lakehouse LLM Explorer. Wrapper for spark, databricks and langchain processes

CLI tool to expose LLMs through messaging clients (Telegram, Discord, Slack, etc.)

A framework that enables efficient extraction of structured data from unstructured text using large language models (LLMs).

Extract structured, validated JSON from any LLM — OpenAI, Anthropic, Gemini — with batch extraction, caching, per-field confidence scoring, schema evolution, multi-schema extraction, output transforms, partial extraction, extraction diff, pipeline extraction, and smart auto-retry.

This package is a utility library for interfacing with multiple Large Language Models (LLMs) using a common interface.

Een package om LLM modellen te initialiseren op basis van provider.

A toolkit for interacting with various Large Language Models

Multi-LLM provider client with automatic failover and priority ordering

Detection and pattern library for LLM agent failures

LLM CLI plugin for fal.ai generative AI models and services

Microlib for the Falcon LLM

Automatic failover between LLM providers. When OpenAI is down, seamlessly switch to Anthropic, Google, or any backup.

A comprehensive Python library for managing fallback mechanisms for Large Language Model (LLM) API calls using LiteLLM

Automated feature engineering using Large Language Models (LLMs) for tabular data

Generate interpretable feature schemas and tabular exports from text, images, tabular data, and video with LLMs

LLM plugin for analyzing FEC campaign finance filings

A Python client for the LLM Feedback API.

A thin, fast, observable Python client for LLMs

A tool to combine files in a folder for LLM processing

Token-efficient data format converter for LLM contexts

AI-powered filesystem cleanup tool with interactive CLI

Load LLM templates from the filesystem

Black-box LLM fingerprinting system for model identification

Access fireworks.ai models via API

One line: which open-source LLM works best on your local machine today.

Pytest plugin for running non-deterministic LLM tests with automatic retry and beautiful reports

a python library that lets you quantize any layer your llm

A prompt graph definition and execution library for LLM app development.