Riley Brown turns an existing phone companion into a focus assistant by pairing an iOS app with a Mac app. He describes using voice inputA voice interface lets people interact with software through spoken input and audible responses. to set a task and connecting the two devices with a QR code.
The proposed workflowWorkflow automation uses software or AI to complete a connected sequence of routine steps with less manual effort. captures the computer screen every 30 seconds and sends the image and task contextA vision-language model jointly processes images and language so it can describe, answer questions about or act on visual information. to a decision model that classifies activity as on task, off task or uncertain. Riley Brown describes using repeated confident observations and a cooldown to reduce unnecessary interruptions.
Riley Brown asks a coding agentAn AI coding agent is a tool-using AI system that can inspect, modify, and validate software within a repository. to update the apps and tests a development mode. In the demonstration, the companion recognizes an unrelated social media detour, offers a nudge and displays a session summary.
Watch on YouTube
