State of Data — Sean Cai, Independent / State of Data

AI Engineer18m 22s
Sean Cai in a blue shirt gestures beside the blue-and-white headline “REAL WORKFLOW DATA” on a black background.
1 VIEW
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Sean Cai distinguishes authentic professional trajectories from manufactured training tasks. Finished spreadsheets and records omit the decisions, tool use, recovery and changing constraints that produced them, so collecting more examples is not automatically the same as improving training signal.

    He evaluates domains through decomposition, expert agreement and access to verified real examples. Finance-task illustrations show how similar aggregate scores can conceal opposite arithmetic and methodological weaknesses. A benchmarkA benchmark is a defined test or collection of tasks used to compare a system's performance under specified conditions. also measures its scaffoldAn AI agent harness is the software framework that packages a model with tools, instructions, context management, execution controls, and user interaction. and grading conditions, and vendors selling both tests and training material can create misleading incentives.

    Cai describes opportunities in enterprise model routingAI model routing sends each request to a model chosen for that request's complexity, cost, speed, privacy, or other requirements., repeated post-training and maintained reinforcement-learning environments. Robotics provides a counterexample because the right data modality remains unsettled. Market estimates, vendor examples and historical comparisons are the speaker's analysis rather than independently verified forecasts.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows56.6
    • Coding & tools0
    • Models & learning89.9
    • Infrastructure & compute75.8
    • Research & evaluation100
    • Safety & security0
    • Business & productivity81.8
    • Creative & media0
    • Robotics & perception42.4
    • Society & policy0

    Share this video

    Sean Cai in a blue shirt gestures beside the blue-and-white headline “REAL WORKFLOW DATA” on a black background. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 26 July 2026 and duration 18m 22s.

    Sean Cai argues that durable AI data businesses need pipelines into real professional work, credible task-specific evaluations and infrastructure that keeps adapting as models change.