Openai agents

Python library for standardization, optimization and monitoring of LLM API calls

A callback-driven, prefix-safe, lazy LLM stream sanitization library.

Advanced subtitle translator with LLM support for converting SRT to bilingual ASS files using OpenAI, Gemini, or DeepSeek APIs

A provider-agnostic Python interface for routing generation calls across LiteLLM, OpenAI, Ollama, and Watsonx

A simple CLI to chat with LLM Models

Deterministic testing framework for LLM-powered apps — record/replay cassettes, eval scoring, regression testing

Pre-call cost estimation, tracking, and budgets for OpenAI, Gemini, and Claude

Token cost control and auto-optimization for LLM apps — compress prompts, estimate costs, enforce budgets, route to cheap models, and cut LLM spend by up to 60%

Cut your LLM API bill by 30-70% with zero accuracy loss

A lightweight Python library for tracking OpenAI and Anthropic SDK costs with budget alerts

Lightweight drop-in Python decorator to track costs, monitor token usage, and enforce budget/rate limits for LLM API calls

Reusable Flask server for LLM backends (Ollama, LM Studio) with tool calling

OpenTelemetry instrumentation for OpenAI.

OpenTelemetry instrumentation for OpenAI Agents SDK.

Parse LLM API response logs (Anthropic, OpenAI, Google) and generate token / cost reports. Supports a --alert-at budget alarm that exits non-zero when total cost exceeds a threshold. No framework adoption required.

Drop-in token + cost tracker for OpenAI / LiteLLM / Gemini with caching awareness

Auto-capture OpenAI and Anthropic LLM calls for warehousing and observability

plugin for simonw's llm to add a web search LLM agent

AI-powered web content extraction with Large Language Models

Run transcriptions using the OpenAI Whisper API

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

A comprehensive Python wrapper for Large Language Models with database integration and usage tracking

Create a Python package.

LLM4PCG is a python package containing required and utility functions of ChatGPT4PCG competition, but modified to support local LLMs that compatible with OpenAI API interface.

A simplified function decorator for OpenAI and LiteLLM API calls.

A simplified function wrapper for OpenAI and LiteLLM API calls.

A Python package that enables batch submission of prompts to LLM APIs, with simplified interface and built-in async capabilities handled implicitly.

Unified Python client for OpenAI, Azure OpenAI, Vertex AI, Anthropic, Gemini, DeepSeek, OpenRouter, Cerebras, Fireworks, Together AI, LM Studio, Bedrock, LiteLLM, and ChatGPT.

A zero‑dependency wrapper that turns any OpenAI‑compatible endpoint into a hackable one‑liner.

Interact with LLMs via email

A powerful Python toolkit for simplifying LLM integration and management with multi-model scheduling, fault tolerance, and load balancing support

Lightweight LLM API Orchestrator - A fast, multi-provider LLM client with rate limiting and key rotation

Generate Voice From reecho.ai Api In OpenAiBot.

Openaibot Bot Plugin: Sticker,for sending sticker in chat

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs with optional model registry and usage tracking - deprecated

Intelligent caching layer for LLM calls with semantic understanding, async deduplication, and cost control

A lite abstraction layer for LLM calls

Real-time LLM spend enforcement — CLI and tray app

Type-safe LLM output parsing with Pydantic models and Jinja2 prompt templates

大语言模型仿openai接口实现

LLMConf unifies the loading and generation configurations of various LLM backends (e.g. `openai`, `transformers`, `vllm`), simplifying parameter control for experiments and testing.

A professional CLI tool for interacting with OpenAI and Anthropic LLMs with cost tracking

Cycle through multiple LLM providers with smart fallback, load balancing, and unified API with real-time FastAPI dashboard, resilient streaming failover, Pydantic structured output, prompt caching, token budgets, and local/cloud key rotation.

A simple interface to models.dev, the open database of AI model specs, pricing and capabilities

Find LLM cost leaks before your bill does. Static analysis for Anthropic and OpenAI client code.

轻量级 LLM 命令行工具与 Python 库，支持兼容 OpenAI Chat Completions 格式的任意 API 端点。

Read through cache for OpenAI's API.

Secure LLM Mesh over MCP — multi-LLM swarm + industrial IoT + privacy gateway

Automatically make the OpenAI tool JSON Schema, parsing call and constructing the result to the chat model.

OpenAI-first hexagonal Python application scaffold for llmframe.

`LLMfy` is a framework for developing applications with large language models (LLMs).

Lightweight, provider-agnostic LLM calling library — OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock, Ollama

Protect OpenAI and Anthropic API calls from prompt injection, jailbreaks, and data-extraction attacks.

Create Google Calendar event URLs interactively from a natural language description, leveraging LLMs with an OpenAI Chat Completions-compatible API and user edits.

LLMGovernor — anomaly engine for LLM apps (core SDK with optional LiteLLM bundle)

Open-source LLM evaluation framework — 50+ metrics for RAG, agents, safety, async eval, regression tracking, custom benchmarks, and exportable reports

Plug-and-play LLM connector via YAML config

Your Personal AI Cloud -- intelligent proxy, router, and cache for LLMs

Library for replacing function calls with LLM inference.

LLM execution engine — multi-provider streaming, MCP tools, and budget management

A chain message bot based on OpenAI

Production-grade LLM client for Python - 100+ providers, 11,000+ models. Rust-powered.

AI API gateway SDK with cost tracking, budget enforcement, and multi-provider routing for LLM applications

Unified LLM testing lab - test, compare, and interact with multiple AI providers through a single UI

Portability lib for OpenAI, Hugging Face, and FastChat local model APIs

Automatic cost tracking and observability for LLM applications

Automatic cost tracking and observability for LLM applications

Zero-cost local mock server for LLM API resilience testing

Create a Python package.

Reduce LLM costs by 90% - AI recommendations with NO API keys needed!

LLM-powered chart generation Python SDK — create charts with natural language

LLM Package Manager — download, run, and share AI models from the command line

Fast, offline-first LLM pricing lookup with auto-sync from LiteLLM data. Get token costs, context windows, and capabilities for 2500+ models.

A lightweight set of tools to use several llm and embeddings apis

OpenAI-compatible LLM reverse proxy with real-time conversation analytics

Intercept OpenAI inputs

A lightweight Python library providing easy access to popular LLM model names, metadata (context windows, capabilities, pricing tiers), and support definitions. Born from a failed experiment on context data compression for LLMs with finite context windows, this library helps developers manage model names, validate support, search by capabilities, and find models by requirements without hardcoding strings or maintaining spreadsheets.

Unified Python interface for OpenAI, Anthropic, Google, and Ollama LLMs

A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers

AI-friendly llms.txt & sitemap generator for websites. Crawl or import sitemaps, filter pages, and generate curated indexes for LLMs.

Generate llms-brief.txt files from documentation websites using AI

Command-line tool to use Large Language Models in your shell,including OpenAI, Anthropic, PalM, Mistral, Cohere, and more.

Convert natural language to shell commands using LLMs (GPT4All, OpenAI, Ollama)

Know where your AI money goes. Track LLM API costs per feature, per model, per user.

One command. Full LLM stack. Zero config.

A provider-agnostic LLM toolkit with tool calling, skills, and parallel execution.

LLMT aims to make it easy to programatically connect OpenAI and HuggingFace models to your data pipelines, CI/CD, or personal workspaces.

A CLI tool that sends prompts to an LLM and outputs responses

OpenAI provider for llmtest

Type-safe function registration and validation for LLM function calls

Count tokens and explore chat templates using HuggingFace tokenizers or OpenAI tiktoken

Lightweight structured tracing for LLM applications

Auto-track LLM cost, latency, and usage. Two lines of code, every provider.

Text translator using OpenAI-like API.

Automatically find cheaper LLM alternatives while maintaining performance

Automatically find cheaper LLM alternatives while maintaining performance

Record and replay LLM API responses for fast, free, deterministic tests

Lightweight multi-provider LLM client for Python

Lightweight Python SDK for the LLMWise multi-model API (chat, compare, blend, judge, failover).

Effortlessly harness the power of LLMs on Excel and DataFrames—seamless, smart, and efficient!