What is a feedback loop?

Definition

An AI feedback loop connects generated material, ratings, clicks, retrieved documents, or real-world outcomes back into future generation or selection. The loop can improve adaptation when feedback reflects genuine quality, but it can also amplify errors and weak proxies.

Research citation loops are dangerous because several model outputs may appear to be independent confirmations while ultimately repeating one unsupported origin. Provenance, deduplication, primary-source checks, and independent evaluation are needed to break the cycle.

ELI5

A feedback loop happens when the result of an AI process influences what the system does later. Helpful feedback can improve future choices, while misleading feedback can cause the same error to grow stronger over time.

For example, a recommendation system may show more of the videos people click. If clicks reflect genuine interest, the suggestions can improve, but sensational recommendations can also generate clicks and then become overrepresented.

How can an AI feedback loop amplify misinformation?

Generated claims can be published, retrieved, cited, and generated again, making repetition look like independent evidence.

How can a harmful AI feedback loop be interrupted?

Trace provenance, prefer primary sources, identify copied claims, remove unsupported inputs, and use independent verification outside the loop.

  1. A flat illustrated game world beside the words Fable 5.1 Builds Whole Worlds
  2. Bad Sources Look Legit beside a flat citation warning illustration
  3. Portrait of Greg Isenberg beside the words Build AI Employees
  4. The words AI R&D Gets Faster beside a simplified upward feedback loop
  5. A flat cursor illustration beside the headline Agents at Work
  6. Patrick Debois beside the words Fix the System Not the Code
  7. Hossein Niazmandi beside the blue and white headline “AI EVALUATIONS - BEYOND SPREADSHEETS” on a black background.
  8. Dru Knox against a black background beside the blue-and-white headline “BUILD A SOFTWARE FACTORY”.
  9. A flat research feedback loop with blue arrows, a light bulb, gear and growing bars accompanies the blue-and-white headline “INTELLIGENCE EXPLOSION” on black.
  10. AI Improves Itself beside one flat feedback-loop illustration
Definition card for feedback loop: What is a feedback loop?

An AI feedback loop occurs when AI outputs or their consequences become inputs that influence later model or agent behavior.