Coding agents & developer tools
Testing & QA agents
988 agents · most starred first
Testing & QA agents, page 3 of 10
FAT Agent (Fix, Audit, Test) — a Claude Skill that automates post-launch website QA. Audits SEO, security, accessibility, performance, and more.
Open-source preview of Retrace (May 2026). Archived and not maintained. Current release: retracesoftware.com
Agent Skills for Robot Framework
26-framework SDET monorepo: Playwright, Selenium, Cypress, Cucumber, Postman, FastAPI, Pact, AI/LLM eval (DeepEval), agentic AI (LangChain, LangGraph, DSPy, Claude), k6, flakiness detection, site monitoring, failure triage, QMS evidence (ISO 9001/SOC 2), dependency audit · GitHub Actions · DataDog · Terraform IaC
Rebuild a local twin of your app on every push, replay approved business journeys, and report a GitHub check.
RobotFramework-AI is a library that adds AI functionality to the Robot Framework. It can generate test data for you using the RealTestDataGenerator but also reply to your messages with the Chatbot.
🚀 First multimodal AI-powered visual testing plugin for Claude Code. AI that can SEE your UI! 10x faster frontend development with closed-loop testing, browser automation, and Claude 4.5 Sonnet vision.
Agentic Framework which automates Software Testing Processes
Git-based test distillation for Codex agents: catch aggressively, commit reluctantly
Coding Agent Runtime & Evaluation Harness for controlled repository-level software repair
Deterministic code quality gates for OpenAI Codex CLI — catch regressions and feed diagnostics back to the agent.
Cypress Copilot is a Visual Studio Code extension that accelerates BDD (Behavior Driven Development) testing with AI-generated code suggestions
PRO-V: An Efficient Program Generation Multi-Agent System for Automatic RTL Verification
Faster .NET build and test loop for AI coding agents.
Your coding agent says "done". Orvant asks for proof. A skill for Claude Code, Codex and other file-capable agents, plus a Python engine that clarifies the goal, prepares an independent acceptance oracle and accepts work only through an independent gate. Engine workers currently run on Codex CLI. Open beta.
AI-powered CLI tool for API testing and exploration. Chat naturally with your APIs - no scripts, no configuration files, just conversation.
An agnostic AI-driven exploratory test framework that intelligently explores, tests, and validates any application
Cairn — an AI that walks your system and leaves a trail of tests: UI, API, unit, docs.
Open-source, agentic web testing platform.
Prove an AI-written fix actually fixes the bug. mini-ork certify reproduces the bug against your repo's own code, attacks the patch with generated invariants in a Docker sandbox, and returns PROVEN / REFUTED / UNVERIFIED with a JSON certificate. Part of a verifier-gated, multi-model agent runtime.
Playwright Copilot is a Visual Studio Code extension that accelerates BDD (Behavior Driven Development) testing with AI-generated code suggestions.
🐱🐾NekoACM: Neural-network Engine Kit of ACM-ICPC. 基于人工智能大模型的 ACM-ICPC 神经网络引擎工具包,提供自动出题、生成测试数据和题解代码、题目格式解析、题目国际化翻译、虚拟评测机、AI 编程助手等功能。可以作为模块集成到 Online Judge 系统中。
An automated Python tool that uses LLMs and internet to automatically fix your code until it runs perfectly.
Playwright E2E test generation and QA automation pipeline for Claude Code — workflow docs, multi-user flows, mobile audits, and 6 specialized QA agents
New testbed of interactive SWE tasks for coding agents, set in a realistic multi-turn developer driven environment
PerfGPT helps you to analyze your performance test results using OpenAI.
Production-ready Playwright test automation starter for teams and startups: strict TypeScript, Page Object Model, environment management, interactive runner, custom HTML reporting (with optional JIRA integration), quality tooling, CI/CD patterns, and agentic (MCP-ready) extensibility.
An xcresult parser CLI for CI and AI coding agents.
An LLM-driven fuzzing pipeline powered by the GitHub Security Lab Taskflow Agent
Botium CLI - The Selenium for Chatbots
CLI to inspect, screenshot, and control live Tauri development screens without running an MCP server.
Agentic Testing Harness
AI 测试用例生成工具。支持RAG 知识库管理和完整的测试工作流,包含需求分析、测试点设计、测试策略设计和测试用例生成等关键环节。AI Test Case Generator
otdgen is an open-source tool that generates JavaScript/TypeScript/JSON format test data from an OpenAPI schema file in YAML format.
Open-Source Framework for AI-Driven Quality Assurance. No-Code AI Agents for QA Testers. Automate Web, API, Database, and Mobile testing with natural language.
Enterprise-grade platform to generate and execute Cypress, Playwright, WebdriverIO, and Appium end-to-end tests from natural language requirements. (Appium is experimental and requires external mobile infrastructure.)
Your AI-Powered Test Agent for Comprehensive Test Cases Generation and Effective Test Automation leveraging RAG architecture & GenAI
A robotframework library that repairs failing Robot Framework tests automatically via AI
Playwright and Cypress E2E testing skills for AI agents. Generate Playwright tests, review test quality, and debug failures in Claude Code and Codex.
Defect Library for LLM-enabled Software
Agentic QA boilerplate built on Playwright + KATA + TypeScript. Multi-agent skills following the agentskills.io spec, orchestrating the full QA lifecycle: shift-left planning, in-sprint testing, TMS documentation with ROI scoring, KATA automation, and regression with GO/NO-GO. Works across Claude Code, Opencode, etc.
Modular AI-powered testing & monitoring platform — Performance / Test Agent / Test Case Gen / API & UI Automation / Knowledge Base
Claude Code agents and skills for automated Playwright E2E test generation, debugging, and planning using the Page Object Model pattern
✅ Pytest-style test runner for langchain projects
Open AI based app to help you with creating test class, documents, code review and more
Let your coding agent develop firmware on the real board, with the hardware as the gate.
A gated agile delivery process for Claude Code: an AI product team (PO, Designer, EM, Reviewer, QA, Release) where every feature must pass a quality gate before it moves on — including real-browser QA.
Evidence-backed visual regression audits for web apps with Playwright: responsive UI checks, accessibility signals, screenshots, measurements, and reproducible findings.
A system testing framework for executable specifications and runtime verification, built for developers and coding agents
A technical book written with OpenAI ChatGPT
Generate and export repeatable, friendly mock data
Self-learning knowledge system for quality engineering. Rust, SQLite + optional PostgreSQL, ONNX embeddings, hybrid retrieval, Bayesian quality scoring.
End-to-end behavioral testing skills, bare system prompts, and any agent runtime — run real scenarios in an isolated git sandbox, capture the full tool-call trace, and assert it against declarative YAML.
Your coding agent writes the code — CodeFRAME proves it works, and keeps proving it. Every bug you capture becomes a permanent, scoped obligation that blocks the merge until real evidence satisfies it. Works with Claude Code, Codex, OpenCode and Kilocode.
Make your specs actually comprehensive. Pair your specs with tests to make your coding agent stop improvising bad code
面向测试工程师的 AI 测试用例生成与管理平台,将需求结构化、RAG 知识增强、多 Agent 用例生成、质量评测、人工评审与测试执行串成一条可追溯、可恢复的生产链路。
Playwright-style UI testing for Godot & Unity. One semantic automation layer for tests, CI, and AI coding agents via MCP.
Blocks Claude Code and Codex from ending a turn when code changed and no test passed after the last change.
AProver: Agentic Prover for AI-Generated Code — LLM agents + BMC for automated verification of systems software
Open-source AI agent testing framework for browser and native desktop apps, with explicit tool effects, evidence, lifecycle, and trace contracts.
Official Homebrew tap for rook by TestMu AI: agent assurance from the terminal. brew install lambdatest/rook/rook
Autonomous AI Agent Skills to build, verify, and package commercial digital products with zero-tolerance offline QA gates.
A language-agnostic debugging interface for AI agents.
Скилл, агент-тестировщик и бенчмарк для AI-агентов, тестирующих 1С через ROCTUP/1c-testpilot
Generates a test suite from acceptance criteria, then converges code against it with an agent that never sees those criteria.
Token-efficient browser verification for AI coding agents
QAosMonkey is an exploratory testing agent that interacts directly with iOS and Android emulators. Unlike traditional QA scripts that follow rigid, happy-path instructions, QAosMonkey acts like a curious, slightly malicious user. You tell it what to test, and it figures out how to break it.
A QA engineer for your coding agent. It tests each React Native change on a simulator and tells you PASS or FAIL, with video proof.
Script that automates Cracking Sora invitation codes by Brute force
AI-powered computer control for automated testing in your CI/CD pipelines. Factifai agent uses vision models (Claude, GPT-4o) to interact with applications naturally - clicking, typing, and verifying results just like a human would.
Simulated users explore web apps, with replayable browser evidence.
Automated testing for Model Context Protocol servers. Ship MCP Servers with confidence.
Open-source AI agent for UI automation, combining structural and visual understanding of mobile & web interfaces. Toward the next generation of open-source, AI-driven testing.
Redpen makes coding agents prove they are actually done.
The E2E AI testing tool | No ML Overhead
The open standard for agentic software verification: query business rules, assess release risk, and execute autonomous testing workflows.
Code-aware browser testing for AI coding agents. 14 MCP tools, CLI workflows, regression memory, and human-readable QA reports.
Synthetic users that walk your software before real users do.
Official CLI for Lila: the testing framework for startups
An AI-powered tool that translates plain English commands into multi-step API workflows, automating the entire testing process.
AI 测试用例生成系统。基于 DeepSeek + 百炼部署的 RAG 知识库,包含需求分析、测试用例生成、智能运维助手、产品指南等内容
🎯TestPilot - 智能测试用例生成工具--AI test platform for requirement analysis, smart test case generation, and RAG-enhanced QA workflows with Flask + Vue 3.
[ICML 2026] Rule2DRC: Benchmarking LLM Agents for DRC Script Synthesis with Execution-Guided Test Generation
WardenIQ is an open-source AI test intelligence platform that turns requirements, docs, and code changes into test cases, test plans, coverage insights, and release test cycles for smarter QA.
The open standard for agentic software verification: query business rules, assess release risk, and execute autonomous testing workflows.
Automated Unit Test Generation with AI
AI agent that runs your manual test cases in a real browser
Playwright + TypeScript agentic automation framework with a local LLM Wiki/codebase second brian. agent skills, UI/API testing, Page Objects, fixtures and reusable services
Teach your coding agent to prove its own work — evidence, not claims
Multi-agent RISC-V verification and test-generation framework for AI-assisted RTL, ISS, compliance, coverage, and debug workflows.
🚦 Senior-QA review skill for Claude Code: runs a regression hunter + a change reviewer in parallel, then gives one read-only SIGN OFF / DO NOT SHIP verdict with file:line evidence.
It turns Playwright specs from deterministic test scripts into AI-readable QA scenarios for live staging validation.
AI Testing Agent Framework · 16 experts + 32 skills + 49 utils · Multi-LLM (Claude/OpenAI/Qwen/etc) · MCP-native · Open-source · Learn-while-using
Exit-code checks for AI coding agents: catches test tampering in diffs, tests that cannot fail, fixes that only satisfy the tested inputs, and weakened assertions. Benchmarked on 630 real PRs and QuixBugs.
Shipping management app for teaching software testing — manual, UI automation, API and AI/agent testing. SvelteKit + LangChain.
This is an evolving toolkit focused on AI agent experiments that combine the capabilities of Codename Goose, MCP tools, the Robot Framework ecosystem, decentralized LLMs on Ollama, and Docker.
Find locators for UI elements in web applications using natural language.
Compile AI browser agent traces into clean, production-ready Playwright test code.
OpenReq: A modern, open-source API client for testing, debugging, and documenting HTTP APIs.
Unit tests for AI agents