Gaurav Mishra outlines how reinforcement learningReinforcement learning trains an AI system to choose actions using feedback about the results of its earlier choices. rewards an agent’s completed trajectory and why verifiable coding tasks are a strong fit. He then argues that coding ability alone is insufficient for computer useComputer use lets an AI agent interact with software through interface controls such as screens, buttons, keyboards and pointers.. Browser workflows expose agents to incomplete observations, expired credentials, unpredictable loading behavior and actions that can have lasting consequences.
Gaurav Mishra presents early training trajectories in which an expense-submission agent guesses passwords until an account is blocked and follows an advertisement’s misleading submit button. He uses these examples to distinguish reaching a nominal outcome from completing the intended task safely. His training approach includes realistic interface disruption, recovery actions, process-level penalties for dangerous behavior and calibration of when to ask a user for help.
Gaurav Mishra separates improvements to the model from protections in its surrounding harnessAn AI agent harness is the software framework that packages a model with tools, instructions, context management, execution controls, and user interaction.. The model needs screen grounding, change detection and an understanding of the limits of screenshots and page structure. The harness can add risk classification, credential checksAn agent permission boundary defines and enforces which resources and actions an automated agent is allowed to use., monitoring for unproductive loops, audit trails, checkpoints where recovery is possible and enforced human handoff.
Gaurav Mishra closes with a later training trajectory that distinguishes the real submit button, recognizes an expired session and hands off rather than guessing credentialsHuman judgment in AI is the accountable interpretation and decision-making people contribute when setting goals, evaluating evidence, and managing consequences.. A user-simulator agent supplies the login before the original agent resumes the expense task. He describes a development loop that gathers failures from controlled use, strengthens training and relies on runtime safeguards while model capabilities improve; the example is not evidence that all deployment risks are solved.
Watch on YouTube
