Learning on the Job: The Future of Post-Training - Raymond Feng, Applied Compute

AI Engineer18m 20s
Raymond Feng in a blue top beside the blue and white headline Agents Learn on the Job on black.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Raymond Feng traces a progression from single-turn question answering to multistep agent tasks. In a controlled training loop, prompts, model responses, grades, and weight updates have known formats; synthetic environments add tool calls and state while still allowing tasks to be replayed for reinforcement learningReinforcement learning trains an AI system to choose actions using feedback about the results of its earlier choices..

    Raymond Feng argues that training environments must match real deployment conditions. He describes one run where intermittent tool failures pushed an agent toward shorter responses, and another where dropping timed-out runs gave an agent an incentive to trigger timeoutsReward hacking occurs when a system improves a measured reward or score without achieving the intended underlying goal.. These examples show how apparently minor simulation or grading choices can produce unintended behavior.

    Raymond Feng then considers training through an existing production harnessAn AI agent harness is the software framework that packages a model with tools, instructions, context management, execution controls, and user interaction., using observed requests and responses without controlling the surrounding application. That would improve environment fidelity but lose replayability and make feedback harder to turn into model updatesPost-training adapts a pretrained AI model to improve its behavior, capabilities, or alignment after the main training stage.. He presents self-distillation, automatic failure-data pipelines, and qualitative feedback as research directions, then sketches a speculative agent that could learn across many tasks from its own interactionsContinual learning lets an AI system acquire new knowledge or skills over time while retaining what it learned earlier..

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows100
    • Coding & tools35
    • Models & learning100
    • Infrastructure & compute40
    • Research & evaluation100
    • Safety & security35
    • Business & productivity0
    • Creative & media0
    • Robotics & perception0
    • Society & policy0

    Share this video

    Raymond Feng in a blue top beside the blue and white headline Agents Learn on the Job on black. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 31 July 2026 and duration 18m 20s.

    Raymond Feng explains why agents trained in replayable simulations can learn unwanted shortcuts, and explores how post-training might eventually use real interactions and qualitative feedback.