What is a feedback loop?

Definition

An AI feedback loop connects generated material, ratings, clicks, retrieved documents, or real-world outcomes back into future generation or selection. The loop can improve adaptation when feedback reflects genuine quality, but it can also amplify errors and weak proxies.

Research citation loops are dangerous because several model outputs may appear to be independent confirmations while ultimately repeating one unsupported origin. Provenance, deduplication, primary-source checks, and independent evaluation are needed to break the cycle.

ELI5

A feedback loop happens when the result of an AI process influences what the system does later. Helpful feedback can improve future choices, while misleading feedback can cause the same error to grow stronger over time.

For example, a recommendation system may show more of the videos people click. If clicks reflect genuine interest, the suggestions can improve, but sensational recommendations can also generate clicks and then become overrepresented.

Acronyms and aliases

AI feedback loop variantmodel feedback loop variant

Frequently asked questions

How can an AI feedback loop amplify misinformation?

Generated claims can be published, retrieved, cited, and generated again, making repetition look like independent evidence.

How can a harmful AI feedback loop be interrupted?

Trace provenance, prefer primary sources, identify copied claims, remove unsupported inputs, and use independent verification outside the loop.

Videos explaining feedback loop

  1. A flat illustrated game world beside the words Fable 5.1 Builds Whole Worlds
  2. Bad Sources Look Legit beside a flat citation warning illustration
  3. Portrait of Greg Isenberg beside the words Build AI Employees
  4. The words AI R&D Gets Faster beside a simplified upward feedback loop
  5. A flat cursor illustration beside the headline Agents at Work
  6. AI Improves Itself beside one flat feedback-loop illustration
  7. Patrick Debois beside the words Fix the System Not the Code
  8. Mingsheng Hong beside the headline Measure Value Not Tokens in attention blue and white
  9. Carlos Sanchez beside the headline One Visitor One Website Built Live in true white and attention blue
  10. Larissa Schiavo and Max Anton Brewer beside the words AI Agents Need Real-World Evals
    Why AI Agents Need Real-World Evals
    MTS36m 13s