Beyond RLHF: From AI Assistance to Automation

AI Engineer18m 5s
Diogo Almeida in a blue top on black beside the headline ‘BEYOND RLHF’ and blue branching decision lines.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Diogo Almeida opens by contrasting striking AI benchmark progress with the continued need for people to supervise many business decisions. He argues that this tension is easier to understand if AI assistance and automation are treated as different goals: interactive tools need to satisfy a human user, while autonomous systems must make dependable decisionsModel reliability is the degree to which an AI model produces dependable behavior across repeated, varied and operationally realistic use. without one.

    Almeida traces the assistant paradigm to reinforcement learning from human feedbackReinforcement learning from human feedback trains a model using signals derived from human judgments about its behavior or outputs., or RLHF, which optimizes models using human preferences. In his account, that objective can reward confident, agreeable responses even when a task requires calibrated correctnessConfidence calibration measures whether an AI system's stated certainty matches how often its predictions or assumptions are actually correct.. He places current coding assistants in the same broad assistance era, while acknowledging their usefulness. These are his interpretations of model behavior, not a universal finding that all RLHF systems fail at automation.

    He proposes a future stack designed for reliable automationWorkflow automation uses software or AI to complete a connected sequence of routine steps with less manual effort. and more capable software, and says TypeSafe AI is pursuing a different optimization target. The presentation does not disclose or independently validate that system. During questions, he distinguishes pretraining from post-trainingPost-training adapts a pretrained AI model to improve its behavior, capabilities, or alignment after the main training stage. and says the intended objective is calibrated decision-making rather than either human preference or simply verifiable answers.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows55
    • Coding & tools25
    • Models & learning100
    • Infrastructure & compute0
    • Research & evaluation75
    • Safety & security0
    • Business & productivity80
    • Creative & media0
    • Robotics & perception0
    • Society & policy0

    Share this video

    Diogo Almeida in a blue top on black beside the headline ‘BEYOND RLHF’ and blue branching decision lines. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 31 July 2026 and duration 18m 5s.

    Diogo Almeida argues that RLHF shaped highly useful assistants but that reliable automation will require different objectives, calibrated decisions and software designed around autonomous work.