What is learning from observation?

Definition

The system records relevant actions, application state and outcomes, then infers a reusable procedure or example from the demonstration. Observation can capture informal details that a person might forget when writing instructions from memory.

A demonstration is evidence, not automatic authority. The learner should identify uncertainty, exclude passwords and private data and ask the user to review the inferred workflow before repeating consequential actions.

ELI5

Learning from observation lets an AI learn a task by watching someone do it. The person demonstrates the workflow while the system records the important actions and results.

For example, a user can show an assistant how to prepare a weekly report in several applications. Before repeating it, the assistant should present the learned steps and avoid copying passwords or accidental actions from the demonstration.

Frequently asked questions

What can an AI observe in a workflow demonstration?

It may observe application state, clicks, typed content, files, timing and outcomes within the user's approved scope.

Why should an observed workflow be reviewed?

A single demonstration can include mistakes, sensitive information or steps that should not become a general rule.

Videos explaining learning from observation