OmniParser by Microsoft Research converts screenshots into structured data that AI agents can understand and act upon, enabling vision-based GUI automation across desktop and web applications.
OmniParser — Screen Parsing Toolkit for AI Agents
OmniParser by Microsoft Research converts screenshots into structured data that AI agents can understand and act upon, enabling vision-based GUI automation across desktop and web applications.
Agent 可直接安装
这个资产可安装;Agent 先选择当前运行时、检查安装计划,再运行匹配命令。
npx -y tokrepo@latest install edfd1172-4ea3-11f1-9bc6-00163e2b0d79 --target codex先 dry-run 确认安装计划,再运行此命令。
讨论
相关资产
Screenpipe — 24/7 Local Screen and Mic Recording for AI Agents
An open-source Rust application that continuously captures your screen and microphone locally, creating a searchable personal data layer that AI agents can query and act upon.
Deskreen — Turn Any Device into a Secondary Screen via Browser
A desktop application that uses WebRTC to stream your screen or individual app windows to any device with a web browser. Works over WiFi with end-to-end encryption, turning tablets, phones, or old laptops into extra monitors.
Recordly — Polished Screen Recordings Without Editing
An open-source desktop app for creating polished screen recordings with automatic zoom, cursor effects, and backgrounds — no post-production needed.
Recordly — Open-Source Screen Recording and Demo Video Creator
A cross-platform desktop application for creating polished demo videos and screen recordings without video editing skills, available on macOS, Windows, and Linux.