computer-use.md

title	Using GitHub Copilot CLI to interact with desktop applications
shortTitle	Computer use
intro	With computer use, allow {% data variables.product.prodname_copilot_short %} to interact with local desktop applications from {% data variables.copilot.copilot_cli %}.
product	{% data reusables.gated-features.copilot-cli %}
versions	feature copilot
contentType	how-tos
category	Author and optimize with Copilot Build with Copilot CLI
docsTeamMetrics	copilot-cli

Note

{% data reusables.copilot.computer-use-preview-note %}

About computer use

{% data variables.product.prodname_copilot_short %} can interact with desktop applications on your behalf by reading accessible application content and visual context, clicking controls, entering and editing text, pressing keys, scrolling, dragging, and navigating workflows across applications.

This capability is useful for workflows in legacy and GUI-only software that do not provide an API, command-line interface, or MCP integration. It is available for local sessions on macOS and Windows.

For information about its capabilities, controls, and limitations, see AUTOTITLE.

Checking computer use status

In an interactive {% data variables.copilot.copilot_cli_short %} session, enter:

/computer show

{% data variables.copilot.copilot_cli_short %} reports whether the computer-use plugin, MCP server, and associated skills are enabled.

Enabling computer use

In an interactive session, enter:

/computer on

{% data variables.copilot.copilot_cli_short %} saves your preference and enables the bundled computer-use plugin. If your organization has disabled computer use, the CLI reports that it is blocked by managed settings. Your local preference cannot override the policy.

On macOS, computer use guides you through granting Accessibility and Screen Recording permissions.

Using computer use

Computer use works best when you describe the outcome you want, the applications involved, and any important constraints.

For example:

Open APP_NAME and summarize the status information shown in the
main window. Do not change any values or submit any forms.

Replace APP_NAME with the name of an application installed on your computer.

Computer use follows the active {% data variables.copilot.copilot_cli_short %} permission mode. This mode determines whether {% data variables.product.prodname_copilot_short %} asks for approval before controlling an application. Enter /permissions show to review the active mode. When approval is required, choose Allow to grant access for the current computer-use session, Always allow to save the approval for future sessions, or decline or cancel the request.

If you choose Always allow for an application, the saved approval also applies when you use computer use in the {% data variables.copilot.github_copilot_app %} on the same computer. When a prompt appears, confirm that the application and action match your request. Configured deny rules still take precedence.

To interrupt an active operation, press Esc twice.

For information about configuring tool permissions, see AUTOTITLE.

Disabling computer use

In an interactive session, enter:

/computer off

To confirm that the plugin and MCP server are disabled, use /computer show.

Troubleshooting computer use

• If /computer show reports that computer use is unavailable, confirm that the feature is available for your account and that you are using a local session on a supported operating system.
• If computer use is enabled but does not work, use /plugin to check that the bundled computer-use plugin is enabled and /mcp list to check that its MCP server is connected.
• On macOS, confirm that the computer-use helper has both Accessibility and Screen Recording permissions.