Python agents

Fish Audio TTS and STT integration for Vision Agents

Google Gemini LLM integration for Vision Agents

GetStream video/voice integration for Vision Agents

HeyGen avatar plugin for Vision Agents

HuggingFace Inference integration for Vision Agents

Inworld AI integration for Vision Agents (LLM/VLM router, TTS, Realtime WebRTC)

Kokoro TTS integration for Vision Agents

Krisp turn detection plugin for Vision Agents

LemonSlice avatar plugin for Vision Agents

LiveAvatar plugin for Vision Agents

Local audio & video integration for Vision Agents

Mistral Voxtral STT integration for Vision Agents

Moondream 3 vision processor plugin for Vision Agents

Moonshine STT integration for Vision Agents

NVIDIA VLM plugin for Vision Agents

OpenAI plugin for vision agents

OpenRouter plugin for vision agents

Pocket TTS integration for Vision Agents - lightweight CPU-based text-to-speech

Qwen Omni plugin for vision agents

Roboflow object detection plugin for Vision Agents

Sarvam AI STT, TTS, and LLM integration for Vision Agents

Silero plugin for GetStream

Smart Turn detection plugin for Vision Agents

Tencent TRTC edge transport for Vision Agents

TurboPuffer RAG integration for Vision Agents with hybrid search

Twilio plugin for Vision Agents - Voice call integration with media streaming

Ultralytics YOLO plugin for GetStream

Vogent turn keeping plugin for Vision Agents

Wizper plugin for Vision Agents

XAI for stream agents

Vision Llama - Pytorch

Video RAG — a Python library for retrieval-augmented generation over video

A modular Python library for vision-based interactions with AI systems

End-to-end visual document retrieval with ColPali, featuring two-stage pooling for scalable search

A PSO library with a focus on visualization.

a language model with visual context.

💬 Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models

A library for data visualization with LLMs

Visualization tool for various generation tasks on Language Models.

Vital Agent Container Client

Vital Agent Container SDK

Vital Agent Eval Env

Vital Agent KG Utils

Secure sandboxed code execution and agent toolbox

Vital LLM Cluster Manager

Vital LLM Reasoner

ViTax-RAG: Alignment-augmented language model for viral taxonomy classification

The OpenStack RCA Service

Vitrage Horizon plugin

Tempest plugin for Vitrage project

Tempest plugin for Vitrage project

A sample AI

Modular VLA and Environment interfaces.

Super simple vector data storage based on vectorlite

Comprehensive CLI tool and VS Code extension for vision models, AutoML, and local LLMs

A utility package for text generation using vLLM with multiprocessing support.

A high-throughput and memory-efficient inference and serving engine for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

This name has been reserved using Reserver

This name has been reserved using Reserver

vLLM Allocator Adaptor (C/CUDA/Python) using callback shims

vLLM Ascend backend plugin

The most comprehensive benchmarking suite for vLLM inference servers

Block implementation of vLLM

gRPC client for vllm-bootstrap inference service

vLLM plugin: out-of-tree registration of canon-layer architectures (e.g. LlamaCanonForCausalLM from PhysicsLM4)

A CLI tool to conveniently serve LLMs with vLLM

Client for the vLLM API with minimal dependencies

Deploy, manage, and monitor vLLM instances across a GPU cluster from a single web dashboard.

A high-throughput and memory-efficient inference and serving engine for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs

vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)

vLLM CPU inference engine (AVX512 optimized)

vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)

vLLM CPU inference engine (AVX512 + VNNI optimized)

Dfloat11 plugin for vLLM

Diagnostic tool for vLLM inference servers

A unified interface for efficient LLM inference with vLLM and OpenAI-compatible APIs

A high-throughput and memory-efficient inference and serving engine for LLMs

The LEGO set for custom vLLM model plugins — build, test, and deploy custom encoders, poolers, and kernels

A high-throughput and memory-efficient inference and serving engine for LLMs

Forward-only flash-attn

Out-of-tree GGUF quantization plugin for vLLM

Haystack integration for vllm

HPU extension package for vLLM

htop-style terminal monitor for vLLM inference servers

A high-throughput and memory-efficient inference and serving engine for LLMs

Inference locally.

Iterable-based offline generation helpers for vLLM.

LLM-as-a-Judge evaluations for vLLM hosted models

vLLM Kunlun3 backend plugin

vLLM plugin for interacting with activations during inference

A collection of useful util functions

Multi-instance vLLM cluster orchestration and log management

Two-tier (RAM + SSD) KV cache offload connector for vLLM with Marconi-style reuse-aware eviction.

Super simple vLLM server launcher for SLURM/HPC with nested config support

MCP server for vLLM - expose vLLM capabilities to AI assistants