Netflix staff software engineer Rajat Shah describes using AI agents to reduce the manual work of performance engineering. Instead of asking a model to optimize arbitrary code, the workflow starts with structured CPU profilingPerformance profiling measures where a program spends time or computational resources so optimization can target observed bottlenecks. data, identifies expensive paths and traces them to the exact revision deployed in production.
The talk presents a quadratic-time pattern identified from a call stack and a repeated metrics-allocation pattern found across several services. These examples motivate a shared catalog of patterns and anti-patterns, stored as readable Markdown in Git rather than requiring a complex vector-memory system.
Shah keeps the agent's output at the level of a proposed code reviewCode review examines proposed source changes to assess their correctness, clarity and suitability before or around integration.. Functional testsDeterministic software verification checks an output with a repeatable procedure that produces the same result for the same inputs and state. and canary deployments check CPU usage, latency and errors under comparable traffic, while an engineer makes the eventual approval decision. A plausible optimization is not enough when it could change business behavior.
The longer-term approach moves learned patterns into code review and eventually code authoring, so inefficient implementations are caught earlier. The talk recommends building reliable profiling, integration and validation foundations first, then adding bounded orchestration. Greater autonomy requires stronger evaluations, sandboxingAn AI agent sandbox is an isolated execution environment that limits which files, processes, networks, credentials, and external systems an agent can access. and protection against prompt injectionPrompt injection occurs when untrusted content attempts to redirect an AI system's behaviour beyond the authority of that content..
Watch on YouTube




