Automation & computer use

Computer use & desktop agents

727 agents · most starred first

Computer use & desktop agents, page 3 of 8

MuseLite★ 93

MuseLite is an open-source AI workspace combining chat, Agent tools, browser automation, and scheduled tasks for users who enjoy Muse and Dots.

opendesk★ 92

Control 1 or more machines using computer use tools that integrates with your agents

CUA-Master★ 92

CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements

STEVE-R1★ 91

R1-like Computer-use Agent

Aether-desktop-orchestrator★ 91

⚡ Hermes Agent 2026: Next-Gen Multi-AI Desktop Automation Platform

rpc-project★ 90

Minimalistic server (written in C) and a python3 client to allow calling native functions on a remote host for automation purposes

Amadeus★ 90

Real-Time Multimodal AI Agent for Desktop Interaction

UI-Mate★ 90

Advancing Foundation GUI Agents with In-Context Demonstrations

bridge★ 90

TODOforAI Bridge — native C edge agent (PTY relay over Noise-encrypted WebSocket)

ui-act★ 89

A seamless Computer Use agent for Linux

virtui★ 89

tui automation kit for agents, like playwright for the terminal

ExpActivator★ 89

Official code for "Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents".

cuse★ 88

Framework for implementing computer use for AI agents

myna-automation★ 88

Myna Recorder — a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.

myna-macro-recorder★ 88

Myna Recorder — a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.

edge★ 87

Open-source AI agent that runs on your own computer and does your tasks. Any model (Claude, GPT, Gemini, Grok, Ollama), drives your real browser, shell, files, DOCX/XLSX.

CUA-Gym-Hub★ 85

CUA-Gym-Hub: mock web apps as reproducible RL training environments for computer-use agents

ipad_computer_use★ 83

Allow an AI agent to control an iPad through a USB input tool, native screen sharing, and a control server.

mexemplar★ 82

桌面端智能办公助理 - 基于示例学习的 AI Agent,通过示例教学自我学习。本地存储、极低成本、完全离线

UI-Act-model★ 81

An AI agent for interacting with a computer using the graphical user interface

shadow-ai★ 79

Shadow AI: stealth AI assistant for restricted/locked-down environments, enabling cross-device interaction over LAN, screen & audio capture, real-time AI inference, and low-friction automation. Supports OpenAI, Claude, Gemini, Kimi, Antigravity.

OmniMCP★ 78

Labs: a perceive-plan-act computer-use experiment. Not the OpenAdapt product. The product is openadapt-flow: a compiled program that halts unless an independent check passes.

enikk★ 78

Open-source Computer Use Agent that works for Any App (GUI or CLI) by Any Model (Vision or Text).

SCALE-CUA★ 78

Open-source framework for computer use agents: VeriGen verifiable task synthesis, online RL training (AgentRL), and OSWorld/ScienceBoard evaluation.

CanvasTTY★ 75

Your infinite desktop just for your AI agents. Inspired by DriftWM.

terminator★ 73

Completely free opensource alternative to manus, openhands and cua

Myna-Macro-Recorder-Auto-Clicker★ 73

Myna Recorder — a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.

Synapse★ 72

[ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control

electron-mcp-server★ 72

MCP server that lets AI assistants automate, debug and screenshot any Electron app over the Chrome DevTools Protocol — no app changes required.

desktopctl★ 71

OSX launcher and GPU-accelerated CLI tool for AI agents. Open-source computer use tool.

TouchAI★ 71

Your desktop AI agent, always ready

clacky★ 71

An AI buddy that lives on your Windows PC, she sees your screen, points, and actually does things. Open-source Clicky for Windows, built on Claude.

Heliox-OS★ 70

Open-source, local-first desktop AI agent for voice, gesture, gaze, browser and system automation with permission gates and verification.

hypruse★ 70

Computer use for Hyprland - MCP server giving AI agents native hands on your Wayland desktop. No ydotool, no root, no portals.

dsh-computer-use★ 69

Cross-platform Computer Use plugin for DeepSeek Harness: observable desktop automation with an isolated virtual cursor, AX/UIA observation, screenshot vision, and 12 guarded tools.

ACL25-GUI-explorer★ 68

[ACL 2025] GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent

agent-computer-use★ 67

Computer use CLI for AI agents

zedra★ 66

Mobile control plane for AI agents. Rust + GPUI + QUIC. Available on iOS/Android

computer-agent-arena★ 66

[ICLR 2026] Computer Agent Arena: Toward Human-Centric Evaluation and Analysis of Computer-Use Agents

ai-desktop★ 64

AI agent that controls a computer

ai_mime★ 64

Automation harness that compiles a screen recording into a rerunnable script, with LLMs, only at decision points and self-healing reruns.

Hybrid-Computer-Use★ 64

Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"

macLLM★ 63

An agentic macOS desktop tool

mcp-windows-automation★ 63

🚀 AI-Powered Windows Automation Server using Model Context Protocol (MCP) | Control Windows apps, automate tasks, and manage systems through natural language commands with Claude, ChatGPT & other AI assistants | 80+ automation tools

o8★ 63

The review and merge layer for coding agents. Your agents write the code; o8 reviews it, sends it back until it's right, and merges it. Works with Claude Code, Codex, T3 Code and more.

Nullhand★ 61

a self-hosted Linux + macOS agent that lets you remotely control your desktop via Telegram using natural language. Supports local AI for full privacy, bilingual parser (English + Arabic), smart multi-step recipes with state verification, and zero external dependencies.

indesign-cli★ 60

Agent-native CLI for Adobe InDesign automation — 150 tools, HTML ↔ InDesign conversion, and structured JSON returns built for AI agents.

findmy-cli★ 59

Query Find My friend locations on macOS via UI automation, screenshots, and Vision OCR — structured output for CLIs and agents.

ghosthands★ 58

Give an agent real hands and eyes: undetectable, DOM-independent GUI automation. A $4 USB-HID microcontroller for hands, a vision grounding model for eyes, any LLM for a brain.

thursday-agent★ 58

Talk, and a team of bots does the work in a real browser, a shell and your files while she keeps talking. Open source, runs on your machine, on your ChatGPT plan or an OpenAI key. npx thursday-agent

windows-computer-use-mcp★ 56

Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro recorder, intent-based discovery, event watchers). Built with opencode (DeepSeek V4). Ships as MCP server, web UI, and Tauri desktop app.

videogui★ 55

[NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos

knotwork★ 55

An AI agent you build, not just prompt. Local-first Android agent with on-device inference (LiteRT-LM), pipelines you assemble yourself, MCP tool calling, and your confirmation before any risky action.

voice-os★ 54

Run your Mac with your voice — gpt-realtime-2 + agent-desktop. Clone it and teach your agent any app.

HeyAgent★ 54

Your Own Autonomous Computer Agent

PowerSkills★ 52

Windows PowerShell toolkit for AI agents: Microsoft 365 (mail, calendar, Teams, SharePoint, OneDrive) via Work IQ + Microsoft Graph, Outlook COM, Edge browser (CDP), desktop, and system control - all returning structured JSON.

record-and-replay-skill★ 51

Agent-agnostic record & replay skill: watch a user demonstrate a workflow (browser via Playwright, desktop via OpenAdapt) and turn it into a reusable AI-agent skill. Works with Claude Code, Codex CLI, opencode.

SimpAgent★ 50

[ICCV 2025 Highlight] Less is More: Empowering GUI Agent with Context-Aware Simplification

nanomachine★ 50

Nanomachine is a Virtual Machine (VM) AI agent dashboard that enables intelligent operative system automation and control. It provides a modern, intuitive interface for interacting with AI agents that can navigate and perform tasks in web browsers, filesystems, and more.

AgentNetTool★ 50

This is the official code base of AgentNetTool in OpenCUA. Website: https://opencua.xlang.ai/

llama4-computer-use★ 50

Efficient computer use agent powered by Meta Llama 4 Maverick

GUI-Agent-Harness★ 50

Autonomous GUI agent — give it a task, it operates the desktop. Visual memory, one-shot UI learning. Built for OpenProgram.

ruyi-workbench-oss★ 50

开源 Windows 本地 AI 工作台|OpenAI-compatible + Claude CLI,99 个桌面/Office 工具,可回退文件操作与可视化多 Agent 工作流。

win-use-master★ 50

Windows desktop app automation and reproducible evidence Agent Skill

OS-Symphony★ 49

[ACL 2026 Main] Official repository for paper: OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents

openpiscis★ 49

Multi-Agent works on native GUI desktop. Supports skills and IM channel, build-in a IDE for light development. Built on the shared piscis-engine kernel.

holo-desktop-cli★ 49

Desktop agent built on H Company's Holo3 vision-language models

Airlink★ 49

Open-source live workspace where AI agents work alongside your team in real time: live docs, sheets and slides, a shared browser, a Linux desktop and full-duplex voice. Bring Claude Code, Codex, Gemini CLI or any LLM. Self-hosted, MIT. Built by MemoAir (memoair.ai).

automating-mac-apps-plugin★ 49

Agents, Skills and Commands for automating Keynote, Notes, Reminders, Numbers and more using AppleScript and PyXA (JXA too).

smart-vscode-extension★ 48

SmartVscode: Controlling anything of Vscode by natural language

Touchpoint★ 48

Give your AI agent eyes and hands on any desktop — cross-platform accessibility API with MCP server

NestOS★ 48

NestOS is a full-stack GUI automation agent. It's not just "chat-driven". Think of it as a digital teammate with a real screen.

clippy-vision★ 48

Fully local AI assistant that watches your screen to eliminate the context problem. No cloud. No data leakage.

ACuRL★ 47

[NeurIPS'26] "Autonomous Continual Learning for Environment Adaptation of Computer-Use Agents"

Gelato★ 46

🍨 Gelato — From Data Curation to Reinforcement Learning: Building a Strong Grounding Model for Computer-Use Agents

agentd★ 46

A daemon that makes a desktop OS accessible to AI agents

cappuccino★ 45

Cappuccino is an GUI Agent based on desktop screen. It is a Manus-like AI Agent that can be deployed locally.

plip-oss★ 45

Open-source runtime for grounded, model-agnostic computer-use agents with verifiable action receipts.

computeruseprotocol★ 44

Computer Use Protocol is a universal schema for AI agents to perceive and interact with any desktop UI.

OpenPet★ 44

OpenPet: local desktop pet runtime for AI agents. 本地桌宠运行时,支持宠物导入与 CLI/MCP/HTTP API 控制。

AutoBot-AI★ 44

Self-hosted, agentic AI you own — voice, vision-driven browser & computer control, visual workflows, human-in-the-loop approvals, multi-user RBAC, and a knowledge graph. Runs on your infrastructure. Your data. Your AI.

mudriknow★ 44

Open-source desktop AI agent that sees what you see — one hotkey over any window, it answers, acts, or guides you step-by-step.

korgo-bot★ 43

Korgo Bot: persistent AI bots with built-in Orgo cloud computer use.

dsh-computer-use★ 43

Text-first browser & background macOS control for DeepSeek Harness (DSH): target the right process and window without taking the user's pointer. 为 DSH 提供文本优先的电脑控制:后台操作 Chromium 与 macOS,不抢前台、不移动鼠标。

Aetox★ 43

Desktop AI agent for Windows — the execution layer for AI: an architecture that expands what any model can do. Files, shell, browser, documents, and a Code door with language servers, Git and pull-request review. OCR, offline speech, real .xlsx/.pptx/.docx output, MCP, a delegated team of agents. Runs on your machine, with any provider.

munim-computer-use★ 43

Open-source Computer Use MCP server for any coding agent — macOS, Windows, Linux. Accessibility-first, background input, agent pointer, zoom, your signed-in Chrome.

AiPC★ 43

Give the agent "this" and he gets a real PC.

openpisci★ 42

Multi-Agent works on native GUI desktop. Supports skills and IM channel, build-in a IDE for light development.

omnibridge★ 42

An AI agent that identifies legacy serial device protocols autonomously. Built for Claude Opus 4.7 Hackathon 2026.

Operator-Use★ 42

🐧Operator-Use: AI that can do stuffs on your computer

screen-voice-agent★ 41

Open-source macOS desktop AI agent

open-record-replay★ 41

Record desktop workflows once and compile them into reusable AI-agent skills for reliable replay.

PC-Automation★ 41

Give any AI agent real hands on your Mac. A stdlib-only Python CLI for volume, brightness, apps, browser, media, screenshots and mic tests. No dependencies, no daemon.

jev-cua★ 41

Voice and text control for macOS. One floating bar, live UI action selection with Jev, and a continuous observe–act–verify loop.

bigfoot★ 41

An assistant that lives next to your cursor on Windows. It sees your screen, talks with you, draws on things, solves the math you write, and operates your computer. Its AI runs on your PC, so it's private and works offline.

Operator-Use★ 40

🐧Operator-Use: AI that can do stuffs on your computer

orcv★ 39

orcv is an infinite canvas of virtual desktops for visually orchestrating many tasks at once

AI-File-Organizer-Agent★ 38

Uses an AI agent (powered by Google Gemini via the Agno framework) to intelligently propose and execute a plan for organizing files within a specified directory on your computer.

Pupil★ 38

Let agents perceive, indicate, and act in any application.

argus-automation★ 38

Argus Automation — SOTA desktop automation for AI agents. Works with Claude Code, Codex, and OpenClaw.

More in Automation & computer use