Claude Opus 5 Just Ended the Benchmark Era

Stacked Podcast30m 50s
Jack Roberts and Nick Saraev against a black background beside the blue and white headline “USEFUL AI / AT WHAT COST?”.
1 VIEW
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Jack Roberts and Nick Saraev discuss Opus 5 in the first day after its release, focusing on whether familiar-quality output at a lower cost changes model selectionModel selection chooses the AI model whose capability, quality, cost, speed, safety, and operating constraints best fit a task.. They distinguish the most capable model in the abstract from the best value for a specific job, using a price-performance chart and their own trial runs rather than a controlled comparative study.

    The conversation considers different model strengths in coding, design, writing style and security. Viral exploit claims are contrasted with reported evaluation resultsEvaluation is the systematic assessment of a system's behaviour or results against explicit criteria., while allegations about model distillation and unreleased capabilities remain the hosts' interpretation or speculation. The catalogue does not treat those claims as independently established facts.

    Later sections acknowledge frustrating real-world failures and emphasize cost per completed taskCost per completed task measures the total AI, tool, infrastructure, retry, and repair expense for each verified useful outcome. instead of token price alone. The hosts' call to end benchmarksA benchmark is a defined test or collection of tasks used to compare a system's performance under specified conditions. is a provocative opinion, not evidence that measurement has become unnecessary. Model-welfare and self-improvement possibilities are discussed without demonstrating autonomous successor development.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows0
    • Coding & tools25
    • Models & learning75
    • Infrastructure & compute0
    • Research & evaluation75
    • Safety & security25
    • Business & productivity100
    • Creative & media10
    • Robotics & perception0
    • Society & policy25

    Share this video

    Jack Roberts and Nick Saraev against a black background beside the blue and white headline “USEFUL AI / AT WHAT COST?”. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 25 July 2026 and duration 30m 50s.

    Jack Roberts and Nick Saraev argue that useful task quality, speed and total cost matter more than a leaderboard position. Their model comparisons are practical impressions, with speculative claims kept distinct.