An Agentic Engineering Workflow Built on Specs and Evals

David Ondrej1h 11m
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    The guest argues that useful AI agents need a faithful map of an organization's processes, knowledge and dependencies. He suggests documenting those workflows before handing them to models and describes defensive automation that continuously checks the software and personal information he has exposed online. His warnings about future attacks and provider dependence are predictions and opinions, not demonstrated outcomes.

    In a walkthrough of his personal agent setup, he shows how skills encode preferred outcomes rather than every instruction, while bookmarks, conversations and other inputs feed a shared context store. An example turns captured material into candidate work items; he cautions that an agent should not automatically act on every idea found in a conversation.

    The coding demonstration centers on one ideal-state document that records a project's goals, decisions and granular criteria. The guest says those same criteria guide both implementation and evaluation, with deterministic assertions and model judgments used where appropriate. He also shows task routing by required capability and cost. The durable practice is to keep the specification, generated code and checks in agreement while retaining human understanding of the system.

    Original YouTube thumbnailWatch on YouTube

    Share this page

    David Ondrej and Daniel Miessler in blue tops flank the headline ENGINEERING WITH AGENTS on black. Framed in blue with WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 27 September 2026 and duration 1h 11m.

    The interview maps an agentic engineering workflow that captures context, defines an ideal state, routes work to models, and checks code against shared criteria.