Computer Use
Computer Use lets an agent inspect supported apps, read visible content, draft text, choose controls, and perform requested actions. It prefers background-safe methods so your pointer and foreground app remain under your control.
What you need
Section titled “What you need”- Claude, Codex, Cursor, OpenCode, or Hermes as the Assistant backend.
- Accessibility permission.
- Screen Recording permission only when a screenshot is required.
- Computer Use enabled for the connected agent.
Ollama and Local MLX do not have agent tools and cannot control apps.
What it can do
Section titled “What it can do”- Find running apps and supported windows.
- Read a selection, visible text, a browser page, or a browser URL.
- Capture a screenshot when text alone is not enough.
- Open an app or URL in the background.
- Click supported buttons and controls.
- Draft text into an editable field.
- Press explicit keys or shortcuts when you ask.
- Choose a value from a supported selector.
Safety model
Section titled “Safety model”Background by default. The agent does not raise a window or take foreground focus unless you explicitly approve that fallback.
Draft before sending. Filling a field does not submit it. Sending, pressing Return, or clicking a final action requires a separate explicit request.
Inspect before acting. Actions bind to recently inspected app and window state. If the interface changes, the action stops instead of guessing.
Consent for mutations. Super Voice Mode requests consent before an external agent uses mutation tools. You can revoke tool access in Dashboard → Agents → Agent Tools.
Restricted surfaces stay restricted. Password managers and other protected targets cannot be inspected or controlled.
Example requests
Section titled “Example requests”- “Read the selected paragraph.”
- “Open the release notes in the background.”
- “Draft a reply in the open field, but do not submit it.”
- “Choose Canada in the country selector.”
- “Take a screenshot of this window and explain the error.”
Usage limits
Section titled “Usage limits”Computer Use inside the in-app Assistant is included in that Assistant turn. Direct Computer Use from an externally connected MCP client requires Pro Lifetime.
Pro tips
Section titled “Pro tips”- Ask for the outcome instead of prescribing every click.
- Say “draft, but do not submit” when you want a review step.
- Mention the target app when several similar windows are open.
- Grant Screen Recording only when visual inspection is useful; most text reads need Accessibility alone.
- Ask the agent to verify the result after a multi-step action.