Diogo Almeida opens by contrasting striking AI benchmark progress with the continued need for people to supervise many business decisions. He argues that this tension is easier to understand if AI assistance and automation are treated as different goals: interactive tools need to satisfy a human user, while autonomous systems must make dependable decisionsModel reliability is the degree to which an AI model produces dependable behavior across repeated, varied and operationally realistic use. without one.
Almeida traces the assistant paradigm to reinforcement learning from human feedbackReinforcement learning from human feedback trains a model using signals derived from human judgments about its behavior or outputs., or RLHF, which optimizes models using human preferences. In his account, that objective can reward confident, agreeable responses even when a task requires calibrated correctnessConfidence calibration measures whether an AI system's stated certainty matches how often its predictions or assumptions are actually correct.. He places current coding assistants in the same broad assistance era, while acknowledging their usefulness. These are his interpretations of model behavior, not a universal finding that all RLHF systems fail at automation.
He proposes a future stack designed for reliable automationWorkflow automation uses software or AI to complete a connected sequence of routine steps with less manual effort. and more capable software, and says TypeSafe AI is pursuing a different optimization target. The presentation does not disclose or independently validate that system. During questions, he distinguishes pretraining from post-trainingPost-training adapts a pretrained AI model to improve its behavior, capabilities, or alignment after the main training stage. and says the intended objective is calibrated decision-making rather than either human preference or simply verifiable answers.
Watch on YouTube




