Openai agents

A lightweight LLM API proxy framework with network connectivity and usage analysis

A simple LLM client wrapper for OpenAI-compatible APIs

Wrapper library for openai to send events to Libretto

Lifeguard integration with OpenAI

A lightweight LLM agent framework supporting async OpenAI and Anthropic APIs with ReAct agents, TODO-based agents, and built-in tools

The unified LLM runtime — local inference, API proxy, and monitoring. A powerful alternative to Ollama + LiteLLM, built in Rust.

lion openai service integration

A lightweight, extensible framework for building AI agent.

A lightweight Python library for tracking LLM API costs via litellm's callback system

Полнофункциональная интеграция GigaChat API с LiteLLM

Lightweight Python wrapper for LiteLLM with simplified interface for 100+ AI providers. Supports text, images, and documents with conversation management.

Universal LLM API client with Rust-powered polyglot bindings.

Call all RAG APIs using thee same format, Use Azure Search, OpenAI, Pinecone, etc.

Agent Framework plugin for services from OpenAI

Agent Framework plugin for OpenAI Server-Sent Events TTS API

Agent Framework plugin for OpenAI Server-Sent Events TTS API

An adapter to integrate OpenAI Agents as LLM providers for LiveKit.

A OpenAI API compatible REST server for llama.

llama-bench style benchmarking tool for all OpenAI-compatible LLM endpoints

llama-index agent openai integration

llama-index agent openai-legacy integration

llama-index embeddings azure openai integration

llama-index embeddings openai integration

llama-index embeddings openai integration

llama-index llms azure openai integration

LlamaIndex LLM integration for Ferro Labs AI Gateway — route LlamaIndex workloads across 30+ LLM providers via a single OpenAI-compatible endpoint

llama-index llms helicone (OpenAI-compatible) integration

llama-index llms openai integration

llama-index llms openai like integration

llama-index multi-modal-llms azure openai integration

llama-index multi-modal-llms openai integration

llama-index multi-modal-llms openai-like integration

llama-index packs gmail_openai_agent integration

llama-index packs panel_chatbot integration

llama-index program openai integration

llama-index question_gen openai integration

llama-index readers openai whisper integration

llama-index tools openai_image_generation integration

llama-index utils openai

LlamaIndex x OpenAI Realtime integration

Unified interface for multiple LLM providers with advanced features (routing, privacy, logging).

OCR using LLAMA vision model, allowing configuring any OpenAI compliant endpoints and model names.

Open-source, OpenAI-compatible API server with pluggable providers for any model and any infrastructure

Lightweight OpenAI API server on top of Llama local models. Suitable for combined use with Microsoft AutoGen.

An integration package connecting Doubleword and LlamaIndex.

opentelemetry instrumentation for openai's completions api

CLI utility and Python library for interacting with Large Language Models from organizations like OpenAI, Anthropic and Gemini plus local models installed on your own machine.

LLM plugin providing access to 75+ AI models through 1min.ai API v2 (chat-with-ai endpoint) with SSE streaming, attachments, AI memory, brand voice, web search, and persistent options

LLM actor: pool, circuit breaker, retries, metrics

Polymorphic Prompt Assembler to protect LLM agents from prompt injection and prompt leak

LLM Agent Toolkit provides minimal, modular interfaces for core components in LLM-based applications.

A flexible gateway for connecting and managing multiple LLM providers

Lightweight multi-provider LLM API adapter for Python — OpenAI, Anthropic, Google, Mistral, xAI, Qwen, Kimi, DeepSeek, and Z.ai.

A unified interface for querying multiple LLM providers via REST APIs

Unified LLM API provider and engine library

LLM plugin to expose a FastAPI server with compatible APIs for popular LLM clients

LLM Application Performance Monitoring - Real-time monitoring for LLM-powered applications

LLM-App is a library for creating responsive AI applications leveraging OpenAI/Hugging Face APIs to provide responses to user queries based on live data sources. Build your own LLM application in 30 lines of code, no vector database required.

Multi-LLM Provider Library

Automatic micro-batching for HTTP LLM calls and local PyTorch inference, backed by a Rust core.

39% faster TTFT, 67% less KV cache, zero config — autotune optimises local LLMs on Ollama, LM Studio, and MLX

LLM plugin to access Azure OpenAI models

Text-to-speech using the Azure OpenAI TTS API

Batch-oriented LLM annotation workflows for tabular datasets with OpenAI Batch support.

A package to process CSV text data in batches using OpenAI API

A developer-centric CLI tool to systematically evaluate and compare Large Language Models (LLMs)

CLI tool for comparing LLM API pricing, ranked by cost-effectiveness against LMSYS Arena scores

LLM Inference Benchmark CLI - measure TTFT, TPS, ITL, E2E latency for any OpenAI-compatible API

Benchmark LLMs with 10 benchmarks & 132K+ questions. 8 providers: OpenAI, Anthropic, Groq, Together, Fireworks, DeepSeek, Ollama, HuggingFace. Unified CLI + Web dashboard.

Benchmark any LLM provider against your actual prompts — latency, cost, quality

Unified Python library for LLM APIs (OpenAI, Anthropic, Gemini, xAI, Groq, custom)

Pre-flight LLM cost estimation and budget enforcement

Agent Cache Runtime for building cache-aware LLM applications.

Local SQLite cache for OpenAI and Anthropic API calls. One env var, 60-80% cheaper dev loops.

Semantic cache, multi-provider LLM router and cost tracker (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen)

Lightweight caching layer for LLM API responses with TTL and size limits

Cache LLM API calls to speed up development and prevent rate limits

Simple Azure OpenAI call helper

Calculate CO2 emissions from LLM API calls following Green Software Foundation standards.

A simple CI/CD utility for running LLM tasks with Semantic Kernel

An OpenAI LLM based CLI coding assistant.

A Python wrapper for managing OpenAI API and other LLM models.

Command-line interface for LLMs with advanced features like tool calling, file handling, and more.

Production-grade LLMOps infrastructure for context window management, token counting, document chunking, and compression

Composable building blocks for LLM context engineering

Portable, model-agnostic memory layer for LLM conversations

Cost tracking for OpenAI, Gemini, and Claude APIs with session management

Estimate LLM request cost and enforce per-request or per-session budgets. Python port of @mukundakatta/llm-cost-guard.

Real-time cost monitoring and budget enforcement for LLM API calls

Python SDK for LLM Cost Monitor - Track, aggregate, and analyze LLM usage costs

Automatically reduce LLM API costs. Routes to cheapest model that succeeds. Use kalibr instead.

Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.

Track LLM API costs per request. Know where your tokens go.

A minimal, auditable Python library for calling multiple LLM providers. Lightweight LiteLLM alternative.

A CLI tool for comparing LLM outputs — semantically, visually, and at scale

LLM model discovery and tracking system for real-time monitoring of available models across multiple providers

Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics

Model distiller automator — recursively drives an LLM with seed prompts and stores compressed outputs in SQLite

AI-powered documentation generator for code projects

A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).