What is data curation?

Definition

Data curation determines which examples enter a dataset, how duplicates and errors are handled, what metadata is retained and whether important cases are adequately represented. High-quality curation can matter as much as raw dataset size because models learn from the examples and structure they receive.

Curation is an ongoing process rather than a one-time cleanup. Product failures can reveal missing cases such as exact dimensions, identity preservation, brand terminology or repeated edits, allowing later datasets and evaluations to target weaknesses found in real use.

ELI5

Data curation is the careful work of choosing and organizing the examples used to build or test an AI. It is similar to preparing a useful library by removing broken copies, adding labels and making sure important subjects are represented.

For example, a media model may need examples of the same person across several edits so it can learn identity consistency. If those examples are missing or badly labelled, adding more unrelated data may not fix the problem.

Why does data curation matter for AI models?

Models learn patterns from their data, so errors, gaps, duplicates and unbalanced examples can directly affect reliability and behavior.

Does data curation end after training begins?

No. Evaluation and product failures can reveal missing or weak examples that should improve later datasets and tests.

  1. Dumitru Erhan, Shixiang Shane Gu, Nicole Brichtova and Shawn Wang beside the words The Next Era of Generative Media
Definition card for data curation: What is data curation?

Data curation is the deliberate process of selecting, organizing, cleaning, documenting and maintaining data for AI development and evaluation.