What is imitation learning?

Definition

Imitation learning uses examples from a human, another agent or a recorded policy to teach behavior. The system learns a mapping from observations to actions or infers the objective behind the demonstrations.

One-shot task imitation aims to reproduce a new behavior from a single demonstration. That is challenging because the agent must separate the essential task from incidental details and adapt it to a new situation. Errors in the demonstration can also be copied, so evaluation and corrective feedback remain important.

ELI5

Imitation learning teaches an AI agent by showing it examples of the behavior to copy. Instead of describing every rule, a person or another agent demonstrates what to do, and the learner tries to connect each situation with the right action.

For example, a robot can watch demonstrations of someone placing cups into a tray and learn a similar movement. It must still work out which details matter, such as the cup position, and which details do not, such as the demonstrator's shirt color. Poor demonstrations can teach poor behavior, so testing and correction remain necessary.

How is imitation learning different from reinforcement learning?

Imitation learning starts from demonstrated behavior. Reinforcement learning improves actions using reward feedback, though practical systems often combine both methods.

What is one-shot imitation learning?

It is the attempt to learn or reproduce a task from one demonstration. The system must generalize the demonstrated intent rather than merely replaying the exact motion.

  1. The words Robots Learn From One Video beside a flat illustration of a robot arm learning a motion
  2. The words Open Models Surge beside a rising three-bar graphic
    The Week Open Models Closed the Gap
    AI Search43m 53s1 VIEW
  3. Roman Yampolskiy and Stuart Russell discuss AI control beside the headline Can AI Stay Correctable on a black background.
  4. AI Improves Itself beside one flat feedback-loop illustration
Definition card for imitation learning: What is imitation learning?

Imitation learning trains an agent to perform a task by learning from demonstrations of behavior rather than relying only on an explicitly written reward function.