Openai agents

Validate LLM responses against schemas, types, and constraints. Catch bad JSON, missing fields, and hallucinated formats before they crash your app.

Exponential backoff with full jitter for LLM API calls. Sync + async. Built-in retryable-code presets for Anthropic, OpenAI, Bedrock, Gemini. Zero runtime deps.

LLM-Rosetta: Unified LLM API adapter — bidirectional conversion between OpenAI, Anthropic, and Google formats via intermediate representation (IR).

Intelligent LLM routing with weighted least-outstanding selection, 429 cooldown, and request class isolation

Route LLM calls through one send_message() across OpenAI-compatible providers and Anthropic's native Messages API; keep a JSONL ledger of every request and response for offline cost reconciliation.

Multi-LLM router MCP server — smart complexity routing, budget-aware model selection, 20+ providers (Claude, OpenAI, Gemini, Ollama, etc.)

DEPRECATED — use pii-veil + pii-core instead. Reversible PII anonymization for Polish documents.

LLM-ify your JSON schemas

Local debugger for LLM API calls — waterfall breakdown of TTFT, cost, and token speed

Small, clean Python SDK for OpenAI-compatible LLM APIs.

A Python library for selecting the best LLM model based on user input using any LLM via LiteLLM

Multi-tier caching platform for LLM embeddings, semantic search, and graph-based conversation memory

Provider and client helpers for signed LLM transcript verification

Multi-provider AI chat interface supporting 9+ LLM providers (Anthropic, OpenAI, xAI, Cohere, Mistral, Perplexity, Gemini, HuggingFace, Groq)

輕量級 LLM 模型追蹤與自動替換 Decorator

LLM Sniffer - OpenAI-compatible reverse proxy with request/response inspector

A Python wrapper for managing OpenAI API and other LLM models.

Track, visualize, and optimize LLM API spending. Two lines of code, zero config.

Track and limit LLM API spending in real-time. Drop-in middleware for OpenAI, Anthropic, Google, and any OpenAI-compatible API.

A comprehensive LLM tracing and monitoring library

Agent framework with tool calling for OpenAI, Anthropic, and Google

Python library for standardization, optimization and monitoring of LLM API calls

A callback-driven, prefix-safe, lazy LLM stream sanitization library.

Advanced subtitle translator with LLM support for converting SRT to bilingual ASS files using OpenAI, Gemini, or DeepSeek APIs

A provider-agnostic Python interface for routing generation calls across LiteLLM, OpenAI, Ollama, and Watsonx

A simple CLI to chat with LLM Models

Deterministic testing framework for LLM-powered apps — record/replay cassettes, eval scoring, regression testing

Pre-call cost estimation, tracking, and budgets for OpenAI, Gemini, and Claude

Token cost control and auto-optimization for LLM apps — compress prompts, estimate costs, enforce budgets, route to cheap models, and cut LLM spend by up to 60%

Cut your LLM API bill by 30-70% with zero accuracy loss

A lightweight Python library for tracking OpenAI and Anthropic SDK costs with budget alerts

Lightweight drop-in Python decorator to track costs, monitor token usage, and enforce budget/rate limits for LLM API calls

Reusable Flask server for LLM backends (Ollama, LM Studio) with tool calling

OpenTelemetry instrumentation for OpenAI.

OpenTelemetry instrumentation for OpenAI Agents SDK.

Parse LLM API response logs (Anthropic, OpenAI, Google) and generate token / cost reports. Supports a --alert-at budget alarm that exits non-zero when total cost exceeds a threshold. No framework adoption required.

Drop-in token + cost tracker for OpenAI / LiteLLM / Gemini with caching awareness

Auto-capture OpenAI and Anthropic LLM calls for warehousing and observability

plugin for simonw's llm to add a web search LLM agent

AI-powered web content extraction with Large Language Models

Run transcriptions using the OpenAI Whisper API

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

Create a Python package.

LLM4PCG is a python package containing required and utility functions of ChatGPT4PCG competition, but modified to support local LLMs that compatible with OpenAI API interface.

A simplified function decorator for OpenAI and LiteLLM API calls.

A simplified function wrapper for OpenAI and LiteLLM API calls.

A Python package that enables batch submission of prompts to LLM APIs, with simplified interface and built-in async capabilities handled implicitly.

Unified Python client for OpenAI, Azure OpenAI, Vertex AI, Anthropic, Gemini, DeepSeek, OpenRouter, Cerebras, Fireworks, Together AI, LM Studio, Bedrock, LiteLLM, and ChatGPT.

A zero‑dependency wrapper that turns any OpenAI‑compatible endpoint into a hackable one‑liner.

Interact with LLMs via email

A powerful Python toolkit for simplifying LLM integration and management with multi-model scheduling, fault tolerance, and load balancing support

Lightweight LLM API Orchestrator - A fast, multi-provider LLM client with rate limiting and key rotation

Generate Voice From reecho.ai Api In OpenAiBot.

Openaibot Bot Plugin: Sticker,for sending sticker in chat

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs with optional model registry and usage tracking - deprecated

Intelligent caching layer for LLM calls with semantic understanding, async deduplication, and cost control

A lite abstraction layer for LLM calls

Real-time LLM spend enforcement — CLI and tray app

Type-safe LLM output parsing with Pydantic models and Jinja2 prompt templates

大语言模型仿openai接口实现

LLMConf unifies the loading and generation configurations of various LLM backends (e.g. `openai`, `transformers`, `vllm`), simplifying parameter control for experiments and testing.

A professional CLI tool for interacting with OpenAI and Anthropic LLMs with cost tracking

Cycle through multiple LLM providers with smart fallback, load balancing, and unified API with real-time FastAPI dashboard, resilient streaming failover, Pydantic structured output, prompt caching, token budgets, and local/cloud key rotation.

A simple interface to models.dev, the open database of AI model specs, pricing and capabilities

Find LLM cost leaks before your bill does. Static analysis for Anthropic and OpenAI client code.

轻量级 LLM 命令行工具与 Python 库，支持兼容 OpenAI Chat Completions 格式的任意 API 端点。

Read through cache for OpenAI's API.

Secure LLM Mesh over MCP — multi-LLM swarm + industrial IoT + privacy gateway

Automatically make the OpenAI tool JSON Schema, parsing call and constructing the result to the chat model.

OpenAI-first hexagonal Python application scaffold for llmframe.

`LLMfy` is a framework for developing applications with large language models (LLMs).

Lightweight, provider-agnostic LLM calling library — OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock, Ollama

Protect OpenAI and Anthropic API calls from prompt injection, jailbreaks, and data-extraction attacks.

Create Google Calendar event URLs interactively from a natural language description, leveraging LLMs with an OpenAI Chat Completions-compatible API and user edits.

LLMGovernor — anomaly engine for LLM apps (core SDK with optional LiteLLM bundle)

Open-source LLM evaluation framework — 50+ metrics for RAG, agents, safety, async eval, regression tracking, custom benchmarks, and exportable reports

Plug-and-play LLM connector via YAML config

Your Personal AI Cloud -- intelligent proxy, router, and cache for LLMs

Library for replacing function calls with LLM inference.

LLM execution engine — multi-provider streaming, MCP tools, and budget management

A chain message bot based on OpenAI

Production-grade LLM client for Python - 100+ providers, 11,000+ models. Rust-powered.

AI API gateway SDK with cost tracking, budget enforcement, and multi-provider routing for LLM applications

Unified LLM testing lab - test, compare, and interact with multiple AI providers through a single UI

Portability lib for OpenAI, Hugging Face, and FastChat local model APIs

Automatic cost tracking and observability for LLM applications

Automatic cost tracking and observability for LLM applications

Zero-cost local mock server for LLM API resilience testing

Create a Python package.

Reduce LLM costs by 90% - AI recommendations with NO API keys needed!

LLM-powered chart generation Python SDK — create charts with natural language

LLM Package Manager — download, run, and share AI models from the command line

Fast, offline-first LLM pricing lookup with auto-sync from LiteLLM data. Get token costs, context windows, and capabilities for 2500+ models.

A lightweight set of tools to use several llm and embeddings apis

OpenAI-compatible LLM reverse proxy with real-time conversation analytics

Intercept OpenAI inputs

A lightweight Python library providing easy access to popular LLM model names, metadata (context windows, capabilities, pricing tiers), and support definitions. Born from a failed experiment on context data compression for LLMs with finite context windows, this library helps developers manage model names, validate support, search by capabilities, and find models by requirements without hardcoding strings or maintaining spreadsheets.

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs

A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers