Choosing AI Models by Cost per Completed Task

Matthew Berman16m 10s
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    Matthew Berman explains tokens as a model's basic units and distinguishes their listed price from the total tokens needed to solve a task. His benchmark examples illustrate how a cheaper token can produce a similar task cost when a model uses more of them.

    Matthew Berman proposes assigning difficult planning to a capable frontier model, implementation to a cheaper and faster model, and final review to another strong model. The cost comparison is an illustrative workflow calculation, not a guarantee that every project will achieve the same savings or quality.

    Matthew Berman also considers latency and competition between open and closed models. He argues that wider availability of model weights can increase competition in inference serving and shift value toward infrastructure and applications. These are his economic interpretations and forecasts.

    Original YouTube thumbnailWatch on YouTube

    Share this page

    Matthew Berman in a blue top beside the blue and white “TASK COST NOT TOKEN PRICE” headline on black. Framed in blue with WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 23 July 2026 and duration 16m 10s.

    Matthew Berman argues that cost per completed task and output speed matter more than token prices alone, and proposes mixing models for planning, execution and review.