Coding agents & developer tools

Testing & QA agents

988 agents · most starred first

Testing & QA agents, page 5 of 10

agentic-debug-mode★ 5

Runtime-evidence debugging for coding agents: session-scoped probes, bounded logs/query CLI, and an agent skill.

flowproof★ 5

Open-source E2E testing an AI agent records for you. Plain-language tests, recorded once on your real app (web, desktop, SAP, Citrix, AI agents), replayed on every commit with zero LLM calls.

TestShift-AI★ 5

AI-native QA patterns for governed automation, RCA triage, agentic workflows, and deterministic Quality Gates.

test-kitchen★ 5

Parallel exploration of implementation approaches - implements multiple variants simultaneously and lets tests determine the winner

topplecat★ 5

🐱 Knocks over your AI agent's "done" claims with hidden retests, mutation gates, and executable acceptance contracts for Java. If it's hollow, it falls.

tycho★ 5

Verify what your AI coding agent actually did. Deterministic local checks, no LLM in the trust path. By Swail Labs.

qamaster★ 5

基于大语言模型的智能研发效能助手。深度解析需求文档,精准识别逻辑漏洞;多维度生成测试用例,提升用例设计效率;构建可复用的测试知识库,将个人经验转化为团队资产。赋能 QA ,实现质量保障智能化。

qa-agent★ 5

An automated, agentic exploratory testing tool that performs comprehensive QA testing on web applications, simulating human user interactions through various input methods (mouse, keyboard, TAB navigation, arrow keys, etc.).

uigraph★ 5

Your app generates its own verified UI transition graph — screens as nodes, guarded (event, effect) edges. Proof-gated verification, trust tiers, model-free MCP for AI agents.

livekit_agent_simulator★ 5

Black-box LiveKit voice agent testing: real WebRTC/SIP calls with an AI caller. Catch barge-in, noise, quiet-mic, and latency failures that text pytest misses. Forensic reports + MCP + lks CLI — no agent code changes.

DSH-changeproof★ 5

DeepSeek Harness 插件:确认改动的代码行真的被测试覆盖到,结论绑定代码指纹,代码一变自动过期

verefi★ 5

AI-assisted pipeline that turns product specs into human-reviewed test plans and executable Playwright automation

cngx★ 5

Run the checks your AI coding agent claimed it ran, and block the merge on a false claim.

offstage★ 5

Let AI agents QA your macOS app in the background. No synthetic input, no stolen focus.

Agent_Quality_Kit★ 5

A check that cannot fail looks exactly like a check that passes. AQK plants a known defect into a copy of your most-repaired file, runs your own declared checks against it, and counts a catch only when one names the planted file. Zero dependencies, one command.

believe-me★ 5

BelieveMe — evidence-first execution harness for safe, verifiable AI code changes

DoneAudit★ 5

Your AI says done. Verify real test, build and Git evidence with a reproducible trust score. MIT; built on agent-done-or-not.

QASkills★ 5
klavity★ 5

Open-core AI bug reporting & testing — right-click to file grounded bugs to Jira/Linear/GitHub/Plane, AI personas (Sims) that review your product, and self-healing end-to-end tests.

TestPilot★ 5

AI 辅助接口自动化测试平台,支持多环境、链式变量、智能用例生成与 HTML 测试报告。

persona-ux-test★ 5

Blind-test products through real desktop and browser UI with isolated AI personas.

web-qa★ 5

Autonomous web-app QA skill for Claude Code: Playwright E2E, visual regression, axe-core a11y. LLM-generated self-healing specs, zero-token test runs.

ai-bug-triage-system★ 5

Hybrid QA bug-triage: deterministic NLP (PT) + LLMs + RAG + MCP with auto-fallback | Gherkin reports for Jira/GitHub | live demo

MaaEvidenceKit★ 5

面向 MaaFramework 的确定性证据提取与诊断辅助工具包 | A deterministic evidence extraction and diagnostic toolkit for MaaFramework.

write-judge★ 5

Your coding agent can't delete the test to make it pass. Pi extension: every edit is judged before it lands.

skilldiff★ 5

Behavioral regression testing for agent skills. Runs your skill in a real agent harness and diffs the behavior on every PR.

agent-nocap★ 5

Your coding agent said "all tests pass" but did they? Don't let agents leave you saying- that's cap! An open-source project by Super Logic AI

qa-skills★ 5

AI-powered QA framework built from reusable skills that teach AI agents (Claude, Copilot, Codex, Gemini) to do quality work like an experienced QA engineer

testcase★ 5

Agent skills that take a requirement to shipped code: audit the spec, turn it into real tests, then build until every check passes. For Claude Code, ZCode, Cursor and Antigravity.

claude-qa-agent★ 5

Eighteen QA workflows for Claude Code: Playwright-BDD UI, API, integration and multi-service tests, exploratory testing, bug filing, fix verification, PR test impact, flaky triage, release readiness, load tests. Works with GitLab, GitHub, Jira, Azure DevOps and Bitbucket.

gutcheck★ 5

Did the agent actually test that? Gutcheck guts each changed function and reruns only its test at the done-claim—proven, hollow, or no binding test, with receipts. Stop hook · GitHub Action · CLI.

quality-skills★ 5

107 production-grade QA engineering skills for AI agents — frontend, API, performance, mobile, security, CI, and AI/LLM testing. MCP-ready: works with Claude Code, Claude Desktop, Cursor, Zed, Windsurf, and any MCP host.

FailGate★ 5

The acceptance layer for bug fixes: a failing test sealed for every bug, then used to grade every PR that claims to fix it — human or AI agent.

testivai-oss★ 5

Local-first visual regression testing for Playwright, Selenium, WebdriverIO, Python, Java and Ruby. Every screenshot is paired with a DOM and computed-style snapshot, so a diff arrives as a verdict — "style-only change on button.cta", "likely render noise" — not a wall of red pixels. MIT, no account, nothing uploaded.

indexer-v1-canary★ 5

Test whether an indexer preserves Message.config instead of silently downgrading v1.

autonomous-web-qa-agent★ 5

Autonomous Web QA & Self-Healing Testing Agent powered by Google Gemini SDK, Playwright, and Pytest. Features dynamic DOM scanning, zero-scripting test generation, live execution, and AST self-healing.

proofseal★ 5

Regression memory for coding agents — seal how your repo behaves, then check over MCP (or in CI) that an edit didn't regress it: pass/drift/regressed/missing. With seal history, bisection, and staleness queries.

run-hound★ 5

AI-assisted automated UI testing agent that hunts for the holes AI-generated apps ship with.

ts-pw-test-assistant★ 5

AI-powered test generation assistant that converts JIRA requirements into structured test cases and executable Playwright + TypeScript E2E tests, with framework-aware code generation and automated quality validation.

argus★ 5

MCP tools that help coding agents test web apps systematically, find bugs, and deliver evidence-backed reports and regression tests for supported findings.

fanout★ 5

Fewer broken merges from parallel Claude Code and Codex sessions: tests every branch merged together before main, and tells each session when another changes code it uses. Works with worktrees. No dependencies.

qa-cube★ 5

A QA team of AI agents for any agent harness: test cases, manual web & API checks, autotests

siftwise★ 5

Open-source test impact analysis for agent-driven CI

testlore★ 5

Build better tests. Run what matters. Remember what worked. An open-source test intelligence and quality engineering layer.

axx★ 5

Acceptance testing for the agentic era.

fakegreen★ 5

fakegreen: catch AI coding agents (Claude Code, Codex, Gemini CLI) faking tests and green builds — skipped/deleted tests, weakened assertions, CI forced green. No LLM, no API key.

perfpilot-hub★ 5

An AG2 multi-agent framework for the performance-testing lifecycle—script generation, load tests, APM correlation, and reports—with HITL gates and A2A so other AI frameworks can request work. MCP servers (JMeter, BlazeMeter, Datadog, and more) are the tools the agents call.

Chisel★ 5

Test impact analysis and code intelligence for LLM agents. Zero dependencies. 15 MCP tools.

Automated-Code-Correction★ 4

🚀 Automated Code Correction Framework An AI-powered debugging tool that: ✅ Captures and logs errors from executed programs ✅ Analyzes errors and provides explanations with real-world examples ✅ Automatically corrects faulty code using LLMs (Google Gemini, OpenAI, Claude, etc.). Built with Python and LangChain.

fixml★ 4

LLM Tool for effective test evaluation of ML projects with curated Checklists and LLM prompts

specter★ 4

🔍 AI-powered autonomous UI testing — describe what to test in plain English, a pipeline of specialized agents will navigate, write, execute, and self-heal the test automatically.

GenTest4AI★ 4

🐦GenAI synthetic scenario testing to bulletproof your APIs, ML models and Agentic workflows.

sloth-python★ 4

AI stock and it's test automation with Python, Pytest, Playwright, Robot, MCP and AI...

leetcode-solver-bot-verify-tool★ 4

command-line tool for automating verify your coding bot performance by LeetCode problem database.

IntelliTest★ 4

Let AI Do It

amock★ 4

AMock 是一个基于 AI 的 Mock API 生成工具,它能够根据简单的描述自动生成完整的 RESTful API 接口和相应的 Mock 数据。

pyqualify★ 4

AI-powered QA & security analysis CLI for any stack — scans web apps, source code, and APIs for vulnerabilities, quality issues, and performance problems. Powered by GPT, Claude, or Gemini.

unit-test-agent-4j★ 4

🤖 Unit Test Agent 4J (uta): A production-ready, AI-powered CLI agent designed to automate JUnit 5 test generation. Built with Java 21 & LangChain4j. Features context-aware analysis, configurable LLM backends (OpenAI/DeepSeek), and a "write-once, run-anywhere" cross-platform architecture.

GameEval★ 4

Autonomous AI-powered game testing platform that uses browser automation and LLMs to evaluate browser-based games through a four-phase pipeline: load validation, control discovery, gameplay exploration, and quality scoring.

video-analysis-agent★ 4

This project implements an AI agent that verifies if automated Hercules test runs were executed as intended by comparing planning logs, video evidence, and final outputs. It uses open-source LLMs and computer vision tools to flag deviations, providing detailed reports with technical insights.

claude-code-tdd★ 4

Fully automated TDD pipeline for Claude Code. Tester, coder, reviewer — separated so the agent can't cheat

webtest-orch★ 4

Token-efficient e2e orchestration skill for Claude Code: explore once, replay deterministically. Playwright + axe-core + run-diff. Tests stay in your repo. MIT.

swarm-test★ 4

Chaos engineering & reliability testing for multi-agent AI systems

appium-pilot★ 4

Agent-first CLI for driving mobile apps via Appium

rchub-qa★ 4

Provide token-efficient, distilled QA docs for AI coding agents to generate accurate test code quickly and reduce token usage significantly

ai-qe-agent★ 4

AI QE Agent with LLM Evaluation Layer — catches hallucinations, monitors chain consistency, self-heals Playwright selectors. Claude + TruLens + LangSmith + Pinecone

UIXCute★ 4

Agentic UI testing in Xcode

QA-testing-agent★ 4

Autonomous email-marketing QA agent that uses Gmail seed inboxes, Gemini, and optional SFMC triggers to test campaign flows, validate content and links, and generate evidence-backed launch-readiness reports.

yo-bug★ 4

MCP Server that gives AI coding assistants QA testing capabilities — point at bugs, AI fixes them

sap-atc-checker★ 4

SAP ATC Checker - Run ABAP Test Cockpit checks with any check variant via SAP ADT API

fixml★ 4

LLM Tool for effective test evaluation of ML projects with curated Checklists and LLM prompts

temper-skills★ 4

Test suites + deterministic Python for your agent skills' decision logic. Adversarial persona reviewers write the tests; the generated code must keep passing them — zero LLM calls at inference. Try: uvx temper-skills audit <skill.md>

CH-M-I-M-AGENT★ 4

Bo cham diem AI Agent dung Skill/Tool cho AutoCAD - Civil 3D - Revit BIM cau. 48 case, 6 hard gate, 197 test cho chinh bo cham.

minottobot★ 4

Your friendly neighborhood QA developer.

selenium-ai-test-generator★ 4

AI-Powered Selenium Test Generator (OpenAI + Ollama)

TestDog★ 4

TestDog is a desktop test case management tool: generate UI test scripts from natural language or manual recording, then replay them as-written with Playwright to verify (everyday regression costs no model tokens). Built for end-to-end regression testing of web applications.

test-osterone★ 4

AI writes web tests from plain-language spreadsheet cases; a deterministic engine judges pass/fail (false-pass = 0). No-terminal Studio UI, Playwright-backed.

Walkthru★ 4

AI test users that run your site's real flows (signup, dashboard, checkout) in your own browser and report where they got stuck, plus SEO and passive security checks. LangGraph persona agents on FastAPI, a Chrome MV3 extension (WXT + React) that snapshots and redacts the DOM, and a React 19 + Vite + Tailwind v4 dashboard on Supabase Postgres.

electronics-qa★ 3

AI-powered quality assurance for electronics design

copilot-audit★ 3

Autonomous multi-agent IDE built on Cloud.ru Evolution that generates, executes, debugs, and self-maintains automated tests.

circinus★ 3

LLM-powered generation-based fuzzer.

open_ai_with_pytest_simple_version★ 3

Integration of OpenAI with Pytest to automate API test generation.

bug-buddy★ 3
mobile-tester-agent-sample-app★ 3

Sample app to be tested by Agentic AI Mobile Tester

auto-harness★ 3

Hook-driven test framework for Claude Code plugins - automates integration testing with YAML/JSON test definitions, variable capture, and rich reporting

Truman★ 3

Synthetic users that get frustrated, rage-quit, and file bug reports. AI-powered UX chaos testing.

visual-mirror★ 3

A simple, practical way to debug visual regressions

project-claudia★ 3

Meet Claudia: An adversarial AI agent for Project Sentinel that relentlessly tests, breaks, and fixes machine-generated code before a human has to review it.

QB_Bot★ 3

QBBot: A human-like AI UI/UX Inspector using Local VLM (InternVL2) and LLMs to autonomously audit web flows, detect visual bugs, and generate professional QA reports.

magdi-community★ 3

Community edition of Magdi-AI for testing and feedback

dusk★ 3

E2E driver for Flutter AI agents. Tap, snap, screenshot, and observe live apps over VM Service and MCP.

codefix-env★ 3

Gymnasium RL environment for training LLM agents to autonomously debug and fix Python code with secure sandboxing and test-driven feedback.

feature-fix-swarm★ 3

Phase-gated, cross-model QA for Claude Code and Codex—catch agent mistakes before they compound.

five46★ 3

Autonomous AI testing agent that verifies your app or API actually works while you're still building it — fully local, BYOK (OpenAI/Anthropic/Gemini/Groq/Bedrock). Outputs real, standalone Playwright/node:test specs.

agent-war-room★ 3

四個 Agents 真的會抓 Bug 嗎?ADK × Antigravity × GEAP 打造可驗證的 Debugging War Room(COSCUP 2026 講題參考實作)

qbuglm★ 3

QBugLM: An Agentic Benchmarking Framework for LLM-based Quantum Software Debugging

copilot-audit★ 3

Autonomous multi-agent IDE built on Cloud.ru Evolution that generates, executes, debugs, and self-maintains automated tests.

mcprigor★ 3

Natural language testing for Model Context Protocol servers. Deterministic, open source, funded by LoopIQ.

OpenPitStop★ 3

A referee your AI coding agent can't cheat. PitStop scans your repo, seals the evidence, catches agents faking test passes, pen-tests your app, and loops fix → verify → re-scan until it's genuinely clean. No telemetry, free, MIT-licensed and everything stays on your machine. Works in Claude Code, Cursor, Codex, OpenCode, and Kilo Code.

test_result_dashboard_streamlit_gemini★ 2

A lightweight dashboard to view and analyze test automation results. Built with Streamlit + PostgreSQL, and powered by AI (Gemini) to help debug test failures faster.

More in Coding agents & developer tools