Evals-Driven Development for a Mental Health AI Coach — Akele Reed & Dave Revere, SonderMind

AI Engineer21m 17s
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    Akele Reed describes SonderMind's mental-health AI coach as support before or between therapy sessions, with human care available when appropriate. Separate input and output guardrails surround the core conversational system, allowing modular testing at additional cost and latency. The talk includes discussion of self-harm, suicide and domestic violence.

    Akele Reed distinguishes active danger from past distress and ordinary relationship difficulties. The engineering aim is context-sensitive intervention rather than more frequent refusals. Dave Revere explains how clinicians annotate ambiguous conversations with the expected intervention, risk category and turn index, turning expert judgment into typed regression evaluations.

    Dave Revere emphasizes false positives, false negatives and intervention timing, rather than optimizing an aggregate benchmark at the expense of users. The speakers announce 200 input and 100 output evaluation scenarios as a starting point, not a replacement for product-specific clinical review. The presentation describes a safety-engineering process; it does not independently establish clinical effectiveness or guarantee safe outcomes.

    Original YouTube thumbnailWatch on YouTube

    Share this page

    Akele Reed in blue and Dave Revere in an off-white shirt flank the blue-and-white headline “CLINICAL AI GUARDRAILS” on a black background. Framed in blue with WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 25 July 2026 and duration 21m 17s.

    Akele Reed and Dave Revere explain how clinician-reviewed traces become repeatable guardrail evaluations, balancing missed risks, unnecessary intervention and appropriate human handoff.