What is computer use?

Definition

Computer use lets an AI system work with applications through their visible interfaces. The system can inspect the current screen, choose a relevant control, perform an action, and observe the updated state before deciding what to do next.

This creates a feedback-rich workflow because the agent can inspect and test what it creates. Reliability still depends on accurate perception, current application state, permission boundaries, and whether the agent recognizes and corrects mistakes.

ELI5

Computer use lets an AI agent work through visible software controls much like a person using a screen, mouse, and keyboard. It is useful when an application does not provide a suitable direct tool or programming interface.

For example, an agent can open a settings page and select an approved option. Before clicking, it should refresh the visible state and confirm the correct window because layouts can change and a mistaken action may be difficult to undo.

Acronyms and aliases

computer-using agent synonymAI computer use variantcomputer-use agent variant

Frequently asked questions

Why is visual inspection important in computer use?

It helps the agent confirm whether an action produced the intended visible result and identify problems that require correction.

Does computer use guarantee correct control of an application?

No. The agent can misread controls, lose track of state, or make imprecise actions, so important outcomes should be verified.

Videos explaining computer use

  1. Portrait of Riley Brown beside the headline GPT-6 Astra in Action.
  2. A flat cursor illustration beside the headline Agents at Work
  3. Browser Tasks - Now Run Themselves beside a flat browser automation-loop illustration
  4. Portrait of Greg Isenberg beside the words Build AI Employees
  5. Nick Saraev and Jack Roberts beside the headline Astra in Practice
    GPT-6 Astra in Everyday Work
    Stacked Podcast25m 20s
  6. Wes Roth beside the words Astra Builds While You Sleep
  7. Nathaniel Whittemore beside the headline Fable 5.1 Earns Its Place
  8. Matthew Berman beside the headline Fable 5.1 Cuts Agent Costs
  9. Flat workflow cards converging beside the words Which AI Super App Wins?
    Which AI Super App Wins?
    Riley Brown22m 49s
  10. Nathaniel Whittemore beside the words 9 AI Methods to Try