What is computer use?

Definition

Artificial intelligence computer use gives an agent access to screenshots, pointer actions, keyboard input and application state. It can work with software that lacks a dedicated API by interacting through the same visible interface a person uses.

Graphical interfaces can change unexpectedly and actions may be hard to reverse. Safe systems refresh visible state before each step, limit credentials and destructive actions, and preserve an audit trail for remote or unattended work.

Acronyms and aliases

computer-using agent synonymAI computer use variantartificial intelligence computer use variantcomputer-use agent variant

Frequently asked questions

How does AI computer use work?

A model interprets visual application state and selects mouse, keyboard or other permitted interface actions.

Why use computer control instead of an API?

Computer control can operate applications without suitable APIs, although it is usually less reliable than structured integration.

Videos explaining computer use

  1. Which AI Super App Wins?
    Riley Brown22:49
  2. Why AI Adoption Is Moving More Slowly
    AI Copium17:431 VIEW