How AI Agents Learn From Real Work

AI Engineer17m 46s
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    Shenoy compares AI adoption with the slow diffusion of electricity: a powerful general-purpose technology does not transform an organization until equipment, processes and skills are redesigned around it. Long Lake approaches that problem as an owner-operator, acquiring or partnering with services businesses and taking responsibility when deployed AI fails.

    He describes an autonomy ladderAgent autonomy is the degree to which an AI agent can choose and execute actions without immediate human direction. from copilots to synchronous agents, asynchronous agents, long-running agents and eventually proactive AI coworkers. Teams must earn each increase in autonomy because model capability and user trust vary by task, while interaction patterns that work for software engineering may not transfer directly to property management, architecture or finance.

    The company captures rich traces as agents collaborate with employees on real workAn AI execution trace is a structured record of the steps, tool calls, state changes, and outputs produced during an AI workflow., including tool calls, exceptions, corrections and final business outcomes. Those traces become automatic evaluationsAgent evaluation tests whether an AI agent completes tasks correctly, consistently, and within its required boundaries. and regression tests, support post-training on private operational dataAI model post-training adapts a pretrained model using additional examples, preferences, rewards or domain data after its initial large-scale training., and expose the messy edge cases that are absent from public training corpora.

    Shenoy links continual learningContinual learning lets an AI system acquire new knowledge or skills over time while retaining what it learned earlier. and enablement into one flywheel: usage supplies feedback that improves the agent, and a better agent encourages more usage. Initial adoption still requires software-service co-design, embedding tools in existing systems and working directly with employees to understand how their day-to-day processes actually function.

    Original YouTube thumbnailWatch on YouTube

    Share this page

    Varun Shenoy beside the words Make AI Real Framed in blue with WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 28 August 2026 and duration 17m 46s.

    Varun Shenoy argues that AI diffusion depends on embedding agents inside real operating workflows, not merely improving models. Long Lake uses observed work traces, explicit outcomes and close field deployment to create evaluations and learning loops that make agents more useful over time.