Service that exposes a REST API that can be used to interract remotely with Pytest. It is shipped with a dashboard that enables running tests in a more convenient way.

pytest-agent-digest

A Pytest plugin to generate a Markdown report for AI Agents

pytest-agent-eval

A pytest plugin for LLM evaluation tests with threshold-based pass/fail

pytest-agent-evals

Pytest plugin for evaluating AI Agents

pytest-agent-health

Catch silent agent failures in CI. Behavior lint for LLM agents, powered by agent-failure-debugger.

pytest-agent-observability

pytest plugin that uploads LiveKit-agents eval results to agent-observability

pytest-agentcontract

Deterministic CI tests for LLM agent trajectories — record once, replay offline, assert contracts

pytest-agentharness

Open-source test harness for AI agents that take real-world actions.

pytest-agentkit

Pytest plugin for testing AI agents — mock LLMs, assert tool calls, track tokens, regression-test prompts.

pytest-agents

Pytest plugin framework with AI agent capabilities for multi-agent testing

pytest-allure-spec-coverage

The pytest plugin aimed to display test coverage of the specs(requirements) in Allure

pytest-api-coverage

Pytest plugin for API test coverage analysis

pytest-claude-agent-sdk

Use Claude Code in your pytests, or pytest your own Claude Code agents — or both

pytest-coverage

pytest-coverage-context

Coverage dynamic context support for PyTest, including sub-processes

pytest-coverage-gate

A pre-commit hook that enforces a coverage quality gate using coverage.xml and a baseline file

pytest-coverage-impact

Sensoria: High-fidelity coverage impact analysis for Python.

pytest-coveragemarkers

Using pytest markers to track functional coverage and filtering of tests

pytest-django-haystack

Cleanup your Haystack indexes between tests

pytest-fakellm

Pytest fixtures for the fakellm mock OpenAI/Anthropic server — spin up, reset, and assert with zero boilerplate.

pytest-google-cloud-storage

Pytest custom features, e.g. fixtures and various tests. Aimed to emulate Google Cloud Storage service

pytest-html-object-storage

Pytest report plugin for send HTML report on object-storage

pytest-langchain

Pytest-style test runner for langchain agents

pytest-llm

pytest-llm: A pytest plugin for testing LLM outputs with success rate thresholds.

pytest-llm-agent

LLM Agent for working with pytest

pytest-llm-assert

Simple LLM-powered assertions for any pytest test

pytest-llm-report

Human-friendly pytest test reports with optional LLM annotations

pytest-llm-rubric

A pytest plugin for rubric-based LLM-as-judge testing with auto-discovery and preflight

pytest-llmeval

A pytest plugin to evaluate/benchmark LLM prompts

pytest-llmtest

The pytest for LLMs — fast, Pydantic-based assertions for AI applications

pytest-mockllm

Pytest plugin for mocking OpenAI, Anthropic, Gemini, and LangChain calls

pytest-rage

pytest plugin to implement PEP712

pytest-route-coverage

pytest plugin to generate reports on routes coverage for web applications.

pytest-semantic-llm

Semantic assertions for pytest using LLMs

pytest-storage

Pytest plugin to store test artifacts

pytgpt-bot

AI powered Telegram bot for chatting, text-to-image and text-to-speech conversions

python-agent-input

input() for Claude Code agents

python-agents

Easy to use and powerful AI Agent development framework.

python-ai-ragbot

AI RAG bot utilities for OpenAI + LangChain with FAISS

python-aiconfig-llama

LLama extension for AIConfig Library

python-bedrock

Async Python reimplementation of the Bedrock protocol.

python-bindings-open-agent-solver

python-bunnycdn-storage

This package provides Bunny.net file storage for Django.

python-claude

Python hooks for Claude Code

python-claude-api

The python package that returns Response of Anthropic Claude through API.

python-coverage-comment

Create a Coverage report comment on Github PR

python-easy-llm

A lightweight LLM wrapper that unifies prompt, RAG and multi-provider calls

python-fastllm

python-file-storage

A Python package that exposes a consistent API for working with different storage backends.

python-fragment

Reverse engineered Fragment API that mimics the official webclient

python-fragments

Modern HTML template rendering in Python

python-gemini-api

The python package that returns Response of Google Gemini through API.

python-gemini-multi-api

The python package that returns Response of Google Gemini through API.

python-gpt-image

Build GPT Disk Images on Local Drives

python-gpt3-codegen

Auto generate code using openapi.

python-guerrillamail

Client for the Guerrillamail temporary email server

python-jsl-NullMember

Python Wrapper for JoyShockLibrary using ctypes

python-jsonllm

LLM please cast to JSON

python-langgraph-equations

python-llm

An LLM wrapper for Humans

python-llm-assistant

Telegram group chat assistant

python-llm-factory

A flexible Python factory for working with multiple Large Language Model (LLM) providers (OpenAI, Anthropic, Gemini, Llama) using a unified interface, with robust configuration and extensibility.

python-llm-lucy

My Python LLM project

python-llmexplorer

A Tool that can be used to analyse, monitor prompts usage and LLM ops

python-magento

A Python wrapper to the Magento XML-RPC API.

python-mistralclient

Mistral Client Library

python-monitoring-agent

Simple, os independent monitoring agent

python-net_evi_agent

An openstack multi_tenant network isolation evidence gathering module