Automation & computer use

Computer use & desktop agents

727 agents · most starred first

Computer use & desktop agents, page 4 of 8

Coscribe★ 38

Coscribe is a local, user-friendly, highly agentic working assistant.

gpt-agent★ 37

Fully self hosted chatgpt agent alternative

openleo★ 37

A to-do board like Trello, where AI agents do the cards on their own computer. Sign in with ChatGPT, like Codex. No code.

open-apa★ 35

Open APA (Open Agentic Process Automation) is built on top of our first-place performance in the OSWorld Benchmark. It provides a practical and extensible framework for building computer use agents that can reliably execute long-horizon, real-world tasks across applications, interfaces, and workflows.

IRIS★ 34

Python desktop AI assistant for screen awareness, voice interaction, persistent memory, and computer automation

Computer-Use-Agent★ 33

An AI Agent that is able to control your screen to complste any task

Tarsier★ 33

Semantic UI automation and lightweight accessibility snapshots for LLM agents to interact with Web and Desktop applications.

atlas★ 32

An AI-powered computer-use agent built with Electron. Automate desktop tasks by letting AI see and interact with your OS.

OpenComputer★ 32

Open-source local-first computer-use agent for Linux, Windows, and macOS, powered by local VLMs or compatible APIs.

auto-pilot-computer★ 31

This is a tool that uses GPT4 Vision to operate your computer

Screen-Point-and-Read★ 31

Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"

gpt-computer-agent★ 29

GPT4 for windows, macos and ubuntu

jarvis★ 29

Jarvis - Autonomous desktop agent

ClickAgent★ 29

ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents

son-of-simon★ 28

LLM-powered macOS automation agent. Control Mail, Calendar, Reminders via natural language using AppleScript. Telegram voice commands, browser automation, and 100+ LLM providers.

offline-ai-assistant★ 28

Vision-first AI agent for desktop automation. Fully offline. Powered by YOLO, OCR & ResNet — building towards local intelligence.

agentbridge★ 28

Let AI agents control Classic Mac OS through a shared folder protocol.

multi-agent-computer-use★ 28

Code for the multi-agent computer use project.

Prism★ 27

Prism is a windows desktop ai agent built with electron and a fastapi backend, powered by the google-gemini-3-api. it can understand what is on your screen, plan multi step actions.

raya★ 27

let LLMs control your desktop for tasks

videodb-capture-quickstart★ 27

Give your agents real time desktop perception. Stream screen, microphone, and system audio for live context and actions.

computer-use★ 27

try Computer Use on your Mac with a few clicks

GUI-HARVEST★ 27

GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution

djinn-agent★ 26

Djinn-Agent: A lightweight CLI tool for seamless interaction with Claude's advanced computer-use capabilities, automating complex tasks from the terminal.

dotPilot★ 26

Local-first desktop control plane for AI agents: embedded Orleans host inside the Uno app, Microsoft Agent Framework for agent/workflow orchestration, and provider adapters for Codex, Claude Code, GitHub Copilot, plus local runtimes.

desktop-touch-mcp★ 26

Windows computer-use MCP server: drive any desktop app via semantic discover-then-act targeting (entities + leases, not pixel coordinates), with per-action perception guards, a native Rust UIA engine, Chrome CDP, and Key Locker credential autofill for ssh/sudo password prompts. Works with Claude, Cursor, and any MCP client.

dsh-click★ 26

Cross-platform native desktop control for DeepSeek Harness (Windows first): screen_shot, screen_read, click/type/scroll/key, app_list/app_launch - approval-gated, never stealing foreground focus

Odin-Tabs★ 25

The Odin Tabs extension is a browser extension that allows you to navigate through your browser tabs using speech recognition and the Large Language Model (LLM) of your choice.

Agentic-AI-Computer★ 25

This is a fully autonomous, self-operating computer automation system designed to automate tasks on Windows without any user interaction. It runs scheduled or trigger-based workflows using Python, system tools, and smart agents — ideal for repetitive tasks, bots, or self-executing pipelines.

tine★ 25

Drive a GNOME Wayland desktop from AI agents. CLI-first, no portals, no consent dialogs.

trope-cua★ 25

Background computer use for desktop agents on Windows and macOS

computer-use-extension★ 25

This is OpenAI's computer use hooked up to a chrome extension.

Nova★ 25

Cross-platform Rust computer-use MCP server for macOS and Windows: AX/UIA, screenshots, OCR, pointer and keyboard input, clipboard, stdio, and HTTP.

ghost★ 25

Verified control of the whole desktop for agents on Windows and Linux: apps with no API, windows, shell, browser. MCP server + CLI + REST API.

open-grok-bot★ 25

Open-source alternative to Grok bot with a FastAPI API, Next.js UI, governed computer use, Docker/remote runtimes, approvals, connectors, and local-first state.

rdc★ 25

Remote Desktop Control for AI agents: screenshot, mouse, keyboard and window control of another machine over Tailscale, exposed as MCP tools. Built with Rust

jetkvm-mcp★ 25

Give an AI eyes and hands on a physical computer — MCP server that lets Claude see and drive any machine through a JetKVM (screenshots, keyboard/mouse, boot media, power) on stock firmware

jev-macos-loop★ 25

Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own OpenRouter, Vercel AI Gateway, or TypesafeAI token.

vita-agent-use★ 25

Let an AI agent use your PS Vita.

WindowsWorld★ 25

The benchmark of the ACL 2026 paper "WindowsWorld: A Process-Centric Benchmark of Autonomous GUI Agents in Professional Cross-Application Environments".

awesome-computer-use★ 24

Curated resources about automated GUI computer-use via LLMs. Highly opinionated, focus is on quality vs quantity.

TopoClaw★ 24

TopoClaw: open-source cross-device AI agent for Android and Windows GUI automation, mobile-use, computer-use, social collaboration, proactive assistant 你的全场景 AI 数字助手 -- 跨设备执行、社交协作、主动感知推进

bro★ 24

An LLM computer-using agent (CUA) designed to autonomously perform mundane tasks related to business operations and administration, such as doing accounting, filing paperwork, and submitting applications. The accountant is not your bro, but Bro is.

Paseobility★ 24

Ten reusable skills for projects, browsers, artifacts and computers connected through Paseo.

braus★ 24

Let agents work in your apps while you keep using your Mac.

agent-notch★ 23

macOS computer-use agent in the notch. Long-press, talk, Claude drives the mouse.

clawbridge★ 23

Free, open-source AI agent for browser & desktop automation. Plain English commands, workflow recording, BYOK. No telemetry, no cloud servers needed.

openblob★ 23

Open-source local-first AI desktop copilot with an expressive blob companion, voice and text commands, browser automation, app control, and community-driven capabilities.

netwright★ 23

Playwright-style automation for .NET desktop apps: an MCP server that lets AI agents see, operate and test WPF, WinForms and WinUI apps.

claude-ubuntu-os★ 22

Claude Computer Use API with Ubuntu that enables Claude to interact with and automate desktop environments. It allows seamless command execution through VNC or noVNC, enhancing productivity with secure, containerized workflows with Github Codespaces.

Aetox★ 22

Desktop AI agent for Windows — an architecture that expands what any model can do. Image/video OCR, offline speech transcription, an agent-driven browser, real .xlsx/.pptx/.docx output, MCP, and a delegated team of agents. Runs on your machine, with any provider.

codepier★ 22

把 AI 接入你的真实开发环境。CodePier 让 ChatGPT / MCP 安全连接本地项目、Pi / Codex、Shell、浏览器与桌面能力。

ChatAutomation-AI-Assistant★ 21

Automates chat replies for Messenger and WhatsApp using PyAutoGUI for UI actions, Pyperclip for clipboard capture, and Groq for AI responses. Cycles configured chat positions, skips replying to your own messages, supports dry-run and logging, and includes cursor tools and easy config for fast testing and demos. Ideal for portfolio demos & research.

AppOpener★ 21

Python library to open/close applications in windows.

auto-openclaw★ 21

Give OpenClaw the power to control your desktop — UI-TARS VLM-driven GUI automation

autowright★ 21

Make it easy to automate personal desktop tasks

shots-for-agents★ 20

Oneshot — One-time screenshots for AI agents. Mac menu bar utility.

macos-computer-use-skill★ 20

Standalone MCP server that gives AI agents full GUI control over macOS — screenshots, mouse, keyboard, apps, clipboard, and multi-display. Zero private dependencies.

Shinken★ 20

Train computer-use agents end-to-end on real desktops, at scale: a high-performance runtime where 8K+ live environments on one laptop thread.

Bodhi-AI★ 20

Tauri desktop shell for the local-first Bodhi agent: manages Bamboo startup/reuse and health; packaged builds open the Bamboo-hosted Lotus Next UI.

axstream★ 20

A streaming action language for computer-use agents. LLMs emit one JSON action per line; the executor runs each the moment its newline arrives — while the model is still generating.

qirabot★ 20

AI vision GUI automation for browsers, mobile apps, desktops, and games — no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.

screen-complete★ 19

Screen complete is a proof of concept universal screenshot-based text completion tool.

NyaDeskPet★ 19

A desktop pet application based on Live2D and AI Agent

PreAct★ 19

PreAct: Computer-Using Agents that Get Faster on Repeated Tasks (arXiv:2606.17929). Compile successful runs into verified state-machine programs and replay them 8.5–13× faster with no per-step LLM calls.

openbots★ 19

AI coworkers built to get things done. They access your apps, operate your tools like a human teammate, and deliver finished results.

trope-cua★ 18

Background computer use for desktop agents on Windows and macOS

dsh-computer-use★ 18

Reverse-engineering & re-implementation of OpenAI Computer Use macOS plugin for DeepSeek Harness: 10 MCP tools, JSON-RPC wire protocol, native Swift AX/screenshot/input daemon.

ai-pc★ 18

An assistant for Windows that works inside 118 desktop programs and services through code instead of screenshots. It writes each program's own files or calls its official interface, checks the result, and saves every change as a version. Works with 25 model providers or a local model.

contop★ 17

Your Desktop, From Anywhere. AI-powered remote desktop control from your phone.

muse-desktop★ 17

Desktop app for Muse Code, Meta's coding agent — with opt-in computer use: let it see your screen and drive your Windows apps.

clawtouch-mcp★ 16

ClawTouch MCP server — exposes a real USB-HID keyboard/mouse (Raspberry Pi Pico 2) as Model Context Protocol tools for any LLM agent. MIT.

CDUT-Studio★ 16

CDUT Studio:端侧开源 AI 智能体工作台,集成 AXTree 浏览器自动化、长期记忆反思与科学计算 | CDUT Studio: An open-source, local-first desktop AI agent platform. Engineered with AXTree browser automation, MultiHop-RAG, long-term memory, and WebGPU lab.

MantisClaw★ 15

The only true Desktop agent that can do actual job, Create your company AI brain and departments

pdagent★ 15

Self-hosted Telegram bot — remote control your Windows PC with Gemini AI, OCR automation, live desktop streaming & scheduling.

Screenhand★ 15

Give AI eyes and hands on your desktop. Open-source MCP server for desktop automation — screenshots, UI control, browser automation, OCR. Works with Claude, Cursor, and any MCP client. macOS + Windows.

moching★ 15

Not a chatbot. Not a coding assistant. A digital operator that controls your entire PC — 219 tools, screen perception, HID control, browser automation, Office suite, AI media. One sentence in, finished work out.

O.R.C.A-for-Windows★ 15

Open Reasoning & Computing Agent for Windows: coding, everyday work, local AI, and Computer Use.

ClaudeComputerUseBeta-Win64★ 14

Claude 3.5 Sonnet ComputerUse (Beta) for Win64

desktop-controller-skill★ 14

AI Computer Use for Claude Code — The open-source alternative to OpenAI Codex's playwright-interactive. Dual-engine: Win32 API + Playwright. Control WeChat, DingTalk, Feishu, QQ, Slack, Teams, and any web/Electron app. Automated QA, viewport testing, visual feedback loops.

quicker-rpc★ 14

QuickerAgent: AI desktop assistant for Quicker. Monorepo with QuickerRpc plugin + qkrpc CLI — headless action create/edit/run via MCP, HTTP, or JSON CLI (StreamJsonRpc named pipe).

aoi★ 14

AOI: a model-agnostic perception layer giving computer-use agents adaptive video + audio perception with zero retraining, plus DynaCU-Bench (100 dynamic browser tasks). Paper + benchmark + code.

Nolan★ 14

本地优先的中文语音 AI 管家——说一句话,它替你操作 Windows(GLM-5.2 Agent + 本地 Whisper + GUI 自动化)

appubot★ 14

Free Grok Bot, OpenAI dots and Meta Muse alternative: AI bots that use the real apps on your own Mac, Windows or Linux PC and answer you on Telegram. Runs on Claude Code, Codex, Copilot, Cursor, Grok or OpenCode. Also an alternative to MausBot, OpenBot, OpenClaw, Hermes Agent, Manus and Claude Cowork.

galileo★ 13

Featured at ATCS Fair 2025: An AI assistant, powered by the OpenAI API, that can control your computer and help with day-to-day tasks.

agentdom★ 13

Universal protocol for AI agents to interact with any software — REST APIs, SaaS, desktop, CLI. No screenshots. No scraping. One intent.

cu-playwright-ts★ 13

Maps Claude Computer Use to Playwright

Computer-Autopilot★ 13

🤖 Computer Autopilot - AI-powered Windows automation using natural language. A modern Windows automation tool that lets you control your computer through natural language commands. Features a sleek GUI with chat interface, voice control, and RPA capabilities. Powered by LLMs for intelligent UI interaction and task automation.

arona-agent★ 13

Terminal AI Agent with desktop pet Arona — eye-tracking pupils, voice cloning, Computer Use, TTS/STT, MCP. Built on Pi SDK. TypeScript + Python + Electron.

daban★ 13

你的 AI 搭子,也有自己的电脑。查资料、处理文件、操作应用,多 Bot 协作,随时接管。基于 DeepSeek Harness(DSH)。

clippy★ 12

Clippy rebuilt as a macOS agent that can use your computer. It reads your screen and clicks/types the thing

Openclaw-Connector★ 11

macOS desktop connector for OpenClaw: securely bridge remote agents to your local machine via SSH tunnel and local browser CDP.

Langchain-Nextjs-OpenAI-WebSockets-Natural-Language-UI-Control-with-OpenAI-Funct★ 11

Langchain-Nextjs-OpenAI-WebSockets: Natural Language UI Control with OpenAI Functions

manus-api★ 11

A comprehensive, versatile AI system built with NestJS that provides specialized AI agents capable of performing various tasks through real AI integration, background processing, and system automation.

ovo★ 11

Open-source proactive AI desktop assistant for macOS. Watches your screen, suggests next steps, and runs actions for you — even on a schedule — 100% on your machine.

brah★ 11

Your AI that actually sees and does. A realtime desktop voice assistant that sees your screen, controls your computer, and gets things done, hands-free.

tinycomputer★ 11

Decision model (JEV) based harness to perform Desktop & Browser automation. Written in Rust.

desktop-pilot-mcp★ 10

Universal macOS app automation MCP server — 30-100x faster than screenshot-based computer-use. Uses Accessibility API, AppleScript, and CGEvent.

lattices★ 10

The agentic window manager for macOS — tile windows, manage tmux sessions, index screen text, and give AI agents a 35-method desktop API

deskmate★ 10

Control your device from anywhere using natural language.

More in Automation & computer use