Python agents

Run transcriptions using the OpenAI Whisper API

Cross-platform LLM Wiki agent initializer and platform adapter.

A context engine and wiki skill runner

MCP server + Claude Code skills for Karpathy-style LLM wikis: persistent markdown knowledge bases your agent grows over time.

CLI tools to read and manage LLM Wiki projects on GitHub

LLM-powered markdown knowledge base CLI — knowledge synthesized at ingest time, not query time.

LLM Woodpecker - AI Model Debugging Tool with Chat and Raw JSON modes

Core library for experimenting with LLMs - provides configuration, workers, tools, and LLM integrations

Console UI components for LLM Workers - interactive chat interface and rich terminal output

Evaluation framework for LLM Workers

Command-line tools for LLM Workers - llm-workers-cli and llm-workers-chat

build LLM workflows

CLI tool and workflow manager for common LLMs

LLM utilities and tools

LLM utilities for handling inputs and outputs.

Quick way to access LLM output in CLI and run Code Agents

Wrap a call to any remote LLM model and expose it as an MCP server tool to allow your main model to communicate with other models.

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

A flexible wrapper for LLM providers with caching, async support, and cost tracking

Python library for precise, hardware-aware inference memory estimation of language models.

LLM plugin for models hosted by OpenRouter

A real-time visualization and training tool for GPT-2

A module for creation of endpoint for the open-sourced LLMs

A CLI for LLMs.

LLM plugin for pulling content from Youtube videos

Plugin for LLM that adds support for fetching transcripts from YouTube videos using Supadata API

A LLM plugin for YouTube transcripts as fragments

ChatGLM

An interface that allows you to use LLMs in an ultra-simple way

Enable large language models to output structured data.

llm2geneset

Paper-aligned LLM-only graph construction, benchmark runners, and public-facing evaluation tools for LLM unlearning experiments.

Web Based Multi Purpose Annotation Software

Create a Python package.

Ask GPT to run a command

Convert Large Language Models to Small Language Models with CLI, Web UI, and IDE integration

The official llm2vec library

LLM2Vec-Gen: Generative Embeddings from Large Language Models

Large Language Model for Algorithm Design Platform

Python SDK for llm4agents.com — gasless AI agent infrastructure

Package including any embedder for the LLM4BI project

Create a Python package.

LLM4Data is a Python library designed to facilitate the application of large language models (LLMs) and artificial intelligence for development data and knowledge discovery.

Create a Python package.

A Linter that uses LLM to analyze code

LLM4PCG is a python package containing required and utility functions of ChatGPT4PCG competition, but modified to support local LLMs that compatible with OpenAI API interface.

K9s-inspired observability control tower for LLM & MCP Servers

My LLM tools for shell tasks

Um pacote para previsão de séries temporais usando modelos de linguagem.

LLM-based system for extracting main events from news articles

Tiny helper that calls the LLM7 image-generation endpoint and returns the final image URL.

Validator for LLM7 chat completion requests with Pydantic and model ID constraints.

Utilities for validating and reporting LLM7 API tokens.

A simplified function decorator for OpenAI and LiteLLM API calls.

A simplified function wrapper for OpenAI and LiteLLM API calls.

Multi-threaded explainability for LLMs: words, sentences, documents, images, and tools.

LlmUnify is a library that abstracts connections to major LLM model providers, simplifying their invocation and interoperability.

Tools for fine tuning and serving LLMs

A Python package that enables batch submission of prompts to LLM APIs, with simplified interface and built-in async capabilities handled implicitly.

A simple MCP server that provides a unified interface to various LLM providers using Pydantic AI

A Python library for estimating the cost of LLM API calls

LLM extraction from documents

Identify LLMs by their response fingerprints

Tools for extracting knowledge from GitHub issues, PR comments, etc.

LLMHandler is a unified Python package that provides a single, consistent interface for interacting with multiple LLM providers, offering both structured (typed) and unstructured responses.

A tool designed to evaluate the performance of large language models on mathematical tasks.

A sitreamlined version of "LLM-Math" that judges the math solutions of LLMs.

Package to visualize LLM's Neural Networks activation regions

Common interface for language models.

LLM Gateway Service

Directly Connecting Python to LLMs - Dataclasses & Interfaces <-> LLMs

Giving LLMs the tools for real impact.

Automate tooluse with LLMs

AI-powered Werewolf game with LLM integration and TUI interface

Run llm functions with just inline documentation and no code

A minimal XML parser for structured output from LLM

LLM-ABBA: mining time series via symbolic approximation and large language models

A Python library abstracting the way you interact with LLMs.

提升了系统

LLMs Adapter Package

🎮 AI-Powered CLI Text Adventure Game - Create infinite stories with LLM

A system for orchestrating LLM tasks that exceed context limits

A framework for simplifying the development of AI systems based on LLMs.

Unified Python client for OpenAI, Azure OpenAI, Vertex AI, Anthropic, Gemini, DeepSeek, OpenRouter, Cerebras, Fireworks, Together AI, LM Studio, Bedrock, LiteLLM, and ChatGPT.

A zero‑dependency wrapper that turns any OpenAI‑compatible endpoint into a hackable one‑liner.

Interact with LLMs via email

A service for automatically replying to emails using LLMs.

Add your description here

A powerful Python toolkit for simplifying LLM integration and management with multi-model scheduling, fault tolerance, and load balancing support

A full-access agent pattern.

Talk to your CSV data with your huggingface llm models

Add your description here

Lightweight LLM API Orchestrator - A fast, multi-provider LLM client with rate limiting and key rotation

High performance code search for large codebases

Do you want to talk directly to the LLMs? Try llmapi.