Computer use CLI for AI agents
-
Updated
Nov 6, 2026 - Rust
Computer use CLI for AI agents
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目,支持在 Mac mini/MacBook 上或通过算力棒本地运行推理,实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理,支持复杂多步骤任务规划与执行。
For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.
[ICLR 2026 Oral] ScaleCUA is the open-sourced computer use agents that can operate on cross-platform environments (Windows, macOS, Ubuntu, Android).
Automate with computer-use agent (ComputerUse / CUA) for macOS, Windows, Linux, Browser, iOS & Android. It sees the screen, clicks, types, browses and writes the code too. One agent, every computer.
"AnyTool: Universal Tool-Use Layer for AI Agents"
Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
Open-source alternative to Claude Co-Work built by Claude. with BYOK
[ECCV 2026] Official Repository for "DualTAP: A Dual-Task Adversarial Protector for Mobile MLLM Agents"
Turn intent into work. Open-source Desktop/Web agent harness with long-horizon memory, live evaluation and recoverable batches.
A Swift library for macOS automation — mouse, keyboard, screenshots, image recognition, and AI-powered agents.
Official code for "Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents".
Open-source framework for computer use agents: VeriGen verifiable task synthesis, online RL training (AgentRL), and OSWorld/ScienceBoard evaluation.
let LLMs control your desktop for tasks
Repository for the implementation of MacArena
DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
AOI: a model-agnostic perception layer giving computer-use agents adaptive video + audio perception with zero retraining, plus DynaCU-Bench (100 dynamic browser tasks). Paper + benchmark + code.
Papers, benchmarks, demos, and tools for multimodal coding agents: visual feedback for UI, CAD, 3D, games, charts, and robotics.
Computer Use Examples with API Integration Full Stack
A Lightweight Desktop GUI Agent via Dynamic Focus Vision and Hierarchical Memory. Your AI-powered hands and eyes for desktop automation.
To associate your repository with the computer-use-agents topic, visit your repo's landing page and select "manage topics."