Automation & computer use

Computer use & desktop agents

727 agents · most starred first

Computer use & desktop agents, page 6 of 8

computer.cpp★ 5

Turn any desktop app into an agent-ready API.

oscribe★ 5

If you can see it, Oscribe can click it.

peek★ 5

See and drive any Mac app from your terminal or your AI agent.

codex-computer-use-fix★ 5

Codex Computer Use Fix: repair Computer Use and bundled local plugins on Windows after updates or restarts.

max★ 5

Your Mac, on autopilot — a native, open-source Mac assistant that operates your computer.

Aura★ 5

The real-world Jarvis for your PC — a voice AI that sees your screen and actually drives it: clicks, types, and runs multi-step tasks on its own.

deltabox★ 5

Enterprise orchestration engine for Agentic AI. Instantly deploy highly-scalable, headless visual sandboxes for full computer automation.

runeflow★ 5

Automate your computer with RuneFlow: record clicks and typing, replay workflows, and use anchor-based vision for reliable desktop control

Agent_Extensions★ 5

跨框架 Agent Skills 合集:视频笔记生成、本地识图、Windows 桌面/浏览器自动化,外加 Hermes 语言路由插件。DSH 插件已拆分为独立仓库。

annotate★ 5

Let an AI agent draw on your screen — a macOS menu-bar app that gives agents a pen over MCP.

uictl-mcp★ 5

macOS GUI-automation CLI/MCP server for coding agents

uiacli★ 5

browser-use for Windows desktops — AI agents see and control any Windows app via UI Automation. The missing piece for computer-use agents.

gui_agent★ 5

Lightweight, ultra-fast FastMCP server for Computer Use & GUI automation on Linux and Windows (Mouse, Keyboard, OCR, Video, Web).

PatchWarden★ 5

Turn your ChatGPT conversations into safe, auditable local execution. PatchWarden lets you discuss ideas and plans with ChatGPT, then hand the approved plan to local AI agents for guarded, traceable implementation—with scoped permissions, independent verification, and a complete execution record.Turn your ChatGPT conversations into safe, auditable

connector-desktop★ 5

Device connector for AgiMate: connects a macOS, Windows or Linux machine to your agents as a fixed set of tools and triggers

Chimera★ 5

Chimera Proxy: cross-platform Rust/Tauri desktop client for VLESS, REALITY, XHTTP, TUN, DNS and Mihomo-compatible proxy cores.

guarded-computer-use-mcp★ 5

Windows computer-use MCP server (26 tools) with a human-in-the-loop approval gate: physical-input-only dialogs, signed guard switches, deny/launch lists, hash-chained audit log. 70+ unit tests, green CI.

Antigravity2gptweb★ 5

🤖 桌面 AI Agent × ChatGPT 网页端 × GitHub:纯自然语言驱动的“云端大脑+本地双手”跨平台双向协作桥梁

THEIA-UI-Computer-Use★ 5

THEIA — The Human Environment Intelligence Aperture: a visual perception and UI computer-use plugin for Windows desktop agents.

mcp-serial-hid-kvm★ 5

MCP server that gives AI agents (Claude, etc.) full keyboard, mouse, and screen control of a physical PC via serial-hid-kvm. Includes OCR-based screen reading.

bento-ai-os★ 5

A local-first AI desktop environment: an autonomous agent that builds apps, runs jobs and takes real actions on your machine. Local models via Ollama, or any cloud provider. Self-hosted, MIT.

Nano-Lumen★ 5

Nano-Lumen is resident general-purpose agent for Windows desktop, designed as a persistent-state system: cross-session, crash-recoverable, local-first privacy. (Beta)

slate★ 5

An open-source Linux desktop built for humans and AI agents. Powered by NixOS, with a conversational shell and independent agent input.

better-computer-use★ 5

macOS desktop control CLI for AI agents: find windows, read accessibility trees, click, type, wait.

hyper-hand★ 5

Let AI agents (Claude Code, Codex, any MCP client) control Hyper-V Windows VMs: screenshots, mouse, keyboard, commands, files and checkpoints, with no guest network or password.

agent-seat★ 5

Give your AI its own Windows desktop session while you keep using yours. Local viewer, CLI and MCP. Experimental preview for Windows 11.

nailong-assistant★ 5

🐸 一只住在 Windows 桌面上的奶蛙:日程提醒 + 液态玻璃日程面板 + AI 电脑助手(computer use) + 抓奶蛙/倒计时/闹钟/抛硬币 + 拖文件回收

macos-harness★ 5

Lets coding agents (Claude Code, Codex, pi and others) see and operate macOS apps: screenshots, the accessibility tree, clicks, typing, menus and windows.

reverse-cli-anything★ 5

Reverse-engineer closed-source desktop software into CLI tools for AI agents. Verified CapCut, Axure RP and Shapr3D workflows.

s1★ 5

Voice-first macOS agent — drive your whole Mac by voice: sees the screen via Accessibility, acts via clicks/typing, verifies every step. Fast local System 1 + pluggable System 2 LLM. Beta.

palm★ 5

Use your whole Mac from your phone, in the iPhone app or the phone's browser: the live screen with touch and typing, every app, your files, terminal and coding agents (Claude Code, Codex, OpenCode), over your own Tailscale network. Open source, no account, no Palm server.

Lifeline★ 5

Your PC won't start? Your phone takes over. An open-source AI rescue kit for broken computers, on a rooted Android phone and a USB cable.

Computer-Use-Agent★ 4

A local VLM-powered agent that controls your computer through natural language commands

py2mac★ 4

A Python Interface to macOS Accessibility API for UI Automation and AI Agents.

NimbusAI★ 4

Autonomous AI Agent Desktop Application supporting multi-model AI with full system access for file management, code execution, web search, and browser automation

SamarthyaBot★ 4

SamarthyaBot — A secure, multi-LLM powered AI agent with real OS, web, and automation capabilities for India.

DeepseekComputerUse★ 4

Langchain Agent that can interact with a desktop environment in a secure container.

autonomous-macos-agent★ 4

Goal-directed AI agent that sees your Mac screen, reasons about actions, and operates the desktop autonomously

Merlin★ 4

Deterministic AI assistant that executes real system actions from natural language (pip-installable CLI)

useless-agent★ 4

A little proof-of-concept agent that uses text-only LLMs to navigate Linux desktop

AIveryday★ 4

Let LLMs understand your desktop activities and send you interesting desktop messages from time to time!

LAX★ 4

Language-based AI Communication System

BiamOS★ 4

The AI-Native Workspace OS. Combines a built-in browser with local AI to read web context, bypass API limits via Zero-OAuth Ghost-Auth, and generate visual UI dashboards.

computer-use-mac-demo★ 4

Anthropic's computer use controlling a Macbook

claude-computer-quicklaunch★ 4

A streamlined setup script for Anthropic's Computer-Use Demo environment. This script automates the entire setup process, handling all dependencies and configuration automatically.

OpenDesktop★ 4

⚡ OpenDesktop — AI-powered desktop agent that controls your computer. Voice, vision, automation, memory, 50+ AI providers. Open source.

AOM★ 4

An experimental Application Object Model for helping LLM agents understand, reason about, and operate real apps.

browserground★ 4

Local UI-grounding specialist for hybrid AI agents. Qwen3-VL-2B LoRA. Screenshot + text target → strict JSON bbox. Drop-in for Claude Code, Codex, browser-use. Cuts GPT-4V cost & latency.

AIOverlayAgent★ 4

Free, open-source AI desktop assistant for Windows. Screenshot AI, global hotkeys, multimodal support, and bring-your-own API key.

clawtouch-skills★ 4

ClawTouch skills — markdown operation guides that help LLM agents drive real desktop apps through the ClawTouch HID layer. MIT.

JarvisControlSystem★ 4

Jarvis Control System is an autonomous AI desktop agent for Windows 10/11, inspired by Iron Man's J.A.R.V.I.S. It lets you control apps, windows, and system settings through natural language — typed, spoken, or sent via Telegram. architecture, it's state-aware and self-verifying, with self-learning macros and pluggable LLM backends (Ollama, OpenAI)

py2mac★ 4

A Python Interface to macOS Accessibility API for UI Automation and AI Agents.

Vanta★ 4

Open-source local AI operator: desktop app, terminal, messaging, and automation with a Rust safety kernel that gates every action.

Layco★ 4

Local-first AI co-worker that floats on your screen: ask, point at anything, control your PC. 100% offline. Rust + Tauri + Ollama. | ES: Compañero de IA local que flota sobre tu pantalla: pregunta, señala lo que sea y controla tu PC. 100% sin conexión.

Chatterboii69★ 4

A Python bot that uses OCR and GPT to read on-screen chat messages and auto-generate replies

Deby★ 4

Building Deby — A Local AI Agent Operating System. Privacy • Autonomy • Local First.

navisual★ 4

AI desktop guide that shows you where to click — it observes, never clicks. Free tier (no sign-up), BYOK or local Ollama, source-available.

clickyyy★ 4

Shake your cursor to summon an AI agent that can see your screen and click, type, and act for you on macOS.

computer-use-dsh★ 4

Codex-style computer use plugin for DeepSeek Harness (DSH): screenshot, click, type, scroll & open apps on macOS / Linux / Windows. 桌面自动化 AI Agent 插件。

oswright★ 4

MCP server for Windows desktop automation. Incremental perception instead of a screenshot per step: measured 16.9x fewer tokens per action than the alternatives, with the benchmarks to check it.

adyber-ai★ 4

Adyber AI is an open-source AI desktop assistant that understands natural language and helps you perform everyday tasks. Open apps, search the web, answer questions, play music, and automate actions on your computer, all from one assistant.

UI-Control-for-Deepseek-Codex★ 4

Real Windows UI automation skill for Codex and DeepSeek. Mouse, keyboard and API level control, occlusion rescue, hard safety gate. Every screenshot is read out of band and deleted at once, so the main session stays clean and light - no image bytes, no stale screens, no 413.

Scout-Agent★ 4

AI agent that actually operates your Windows apps — real clicks & keystrokes, persistent memory, 12+ IM channels. An AI Agent that truly operates your desktop

DSH-PC-Manager★ 4

Windows AI PC manager powered by DeepSeek Harness — scoped read-only scanning, safe cleanup review, and privacy-first desktop controls.

pad-lattice★ 4

Physical and virtual control surfaces for Codex CLI: Desktop, phones/tablets, Novation Launchpad, and experimental Elgato Stream Deck support.

NEMESIS-AGENT★ 4

Agent IA autonome pour linux pilotable via NemApi .

vco★ 4

A clicker for LLMs: operate web pages and desktop screens via shell commands.

NirvanaX-AutoAgent★ 4

The ultimate personal AI assistant that hears, sees, and controls your PC. Features a fully customizable, breathing UI with zero subscriptions.

LocoPilot★ 4

⚡ Give any local LLM eyes, a browser, and a mouse — 35 endpoints, zero cloud, one file. Vision • Browser • Desktop autonomy API

G-Mini-Agent★ 4

Agente de IA de escritorio que ve tu pantalla, usa mouse, teclado y navegador, recuerda, habla y sigue trabajando 24/7. 30 proveedores (Vertex AI, OpenAI, Anthropic, Gemini, tu suscripción de Claude o ChatGPT, modelos locales), skills, MCP, conectores y modo servidor.

Cortex★ 4

Safe, screenshot-grounded computer-use MCP server that lets AI agents see, decide and act on the Windows desktop — with semantic verification, fail-closed safety gates and approval controls.

carve★ 4

A Mac agent on a short leash.

remote-harness-mcp★ 4

Remote Harness MCP — turn any PC, laptop, server or Android phone into an autonomous execution node for Gemini via native MCP.

Z-Buddy★ 4

🐾 ZCode 桌宠:会陪你干活的桌面小宠物 — Agent 状态可视化 · 电脑操作协同 · GLM 对话气泡 | A desktop pet for ZCode: real-time agent status, visible computer-use, and GLM-powered chat

screenrecorder★ 3

Agentic Screen Recorder to automate process of your documentation and Bug reproduction

blink-skill★ 3

Proactive screen awareness + Claude Vision assistance

freeu★ 3

FreeU 是AI的文件收纳师

SmudgeAI★ 3

Windows-native autonomous AI agent for desktop automation with vision-based UI navigation, multi-step workflow execution, and LLM-powered reasoning.

openEagle★ 3

A desktop AI agent that sees your screen and acts on your behalf - combining chat, tools, and hands-on GUI automation with a three-tier safety model.

DockWright-MacOS-Agent★ 3

Your Mac. Your AI. A native macOS assistant that sees your screen, hears your voice, runs your tools, and remembers what matters — built entirely in Swift.

ruki★ 3

Ruki - a minimal Windows desktop AI assistant you can teach

ai-worker.app★ 3

Open-source desktop AI workspace for MCP tools, local files, browser automation, and provider-agnostic LLM workflows.

Sara-the-ai-assistant★ 3

Control your desktop with voice commands using this offline Python assistant powered by local LLMs and Whisper speech recognition.

shell-ai-os-controller★ 3

Shell: offline-first AI OS controller for Windows. Voice-controlled desktop automation - 468 tools, 37 agents, audit logging + undo. Local-first, open source (Apache-2.0).

tinydesktop★ 3

Desktop friendly agent automation

yanmasa★ 3

A Windows 11 computer-control agent that gets its own desktop and its own cursor — so it works while you keep using yours. Claude computer-use + PySide6.

Vayu★ 3

Vayu is an open-source, local-first Windows AI desktop command center with safe app control, Ollama/Gemma offline AI, optional multi-provider online AI, permission gates, audit logs, and a futuristic Vayu Sphere UI.

win-mcp-bridge★ 3

Give an AI agent full remote control of a Windows PC - with zero console windows flashing on screen. 让 AI 完全操控你的 Windows 电脑,屏幕上不闪任何黑窗口。

Project-IRIS-Light★ 3

Open Source Desktop AI Agent Runtime - LLM, MCP, Voice Runtime, and local/cloud models wired into one PyQt6 desktop agent (Ollama + Hermes)

plugshell★ 3

An agent-operable host for audio plugins: read parameters and presets, see the editor, and operate the controls that are not exposed as parameters.

My_OS★ 3

AI-native Linux distro (Arch-based): press a hotkey and a local AI assistant drives your PC in natural language — files, packages, settings, apps and the screen itself. Local-first (Ollama + Qwen), optional Claude cloud, and every risky action needs your confirmation. English & French.

doppel★ 3

A computer-use agent with its own desktop and its own cursor — Windows 11 and Linux. It works while you keep using yours. Claude computer-use + PySide6.

POK-Agent★ 3

POK-Agent: a Windows computer-use AI agent. A large model plans (System 2) and a small fast model acts on screen (System 1: JEV or local Laya). Repeated tasks become muscle memory, so the big model is called less every time. Local-first, voice and vision, Rust + Tauri, open source.

Blinkling★ 3

Blink, a small green companion on your desktop: hold Ctrl and click anything on screen to ask Claude about it. Looks and explains, never clicks.

TaskVex★ 3

Windows AI assistant for real-time voice interaction and tool-driven desktop workflows. Built with Python, WebView2 and Gemini Live.

Forge★ 2

Forge — agentic AI orchestration platform with workspace IDE, visual blueprints, computer use, and multi-model support

OpenACM★ 2

Self-hosted autonomous AI agent — runs on your PC, controls your environment, connects to any MCP server.

glass-hands★ 2

GlassHands is a computer-use agent framework

cv-desktop-virtual-assistant★ 2

一款基于计算机视觉驱动的桌面虚拟陪伴助手,为 PC 环境提供智能视觉交互体验。 | A computer vision-powered desktop virtual companion assistant for intelligent visual interaction.

IntelliDesk-Assistant★ 2

This Python-powered virtual assistant offers seamless desktop control through both speech and text commands, simplifying everyday computer tasks. It acts as your intuitive digital helper, allowing you to manage activities effortlessly without lifting a finger.

More in Automation & computer use