Training AI Models for Black-Box Cyber Defense

AI Engineer17m 28s
Uri Rolls in blue and Thomas Wolf wearing glasses and an off-white shirt flank the blue and white “AI CYBER DEFENSE” headline on black.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Thomas Wolf introduces cybersecuritySecurity testing checks whether software controls protect systems and information in defined scenarios. as a demanding test of dynamic reasoning rather than a simple search for code defects. Uri Rolls describes how more capable models change attack economics, while defenders still need systems that operate at scale with limited human intervention.

    The presentation focuses on access-control tasks in large, connected environments. Models receive black-box toolsAI tool calling lets a model request a structured operation from software instead of only returning natural-language text. rather than source code or internet access, and deterministic gradersDeterministic software verification checks an output with a repeatable procedure that produces the same result for the same inputs and state. measure each step of a multi-stage attempt. An illustrative chain shows why gathering facts is not enough when a model misses the logical relationship between different permission checks.

    Uri Rolls shows difficult evaluation resultsEvaluation is the systematic assessment of a system's behaviour or results against explicit criteria. and traces of prolonged unsuccessful attempts. Thomas Wolf closes by emphasizing high-quality data, post-trainingPost-training adapts a pretrained AI model to improve its behavior, capabilities, or alignment after the main training stage. and fast specialized models, arguing that open collaboration can strengthen defense rather than relying on only a few closed-model providers.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows50
    • Coding & tools10
    • Models & learning75
    • Infrastructure & compute0
    • Research & evaluation100
    • Safety & security100
    • Business & productivity25
    • Creative & media0
    • Robotics & perception0
    • Society & policy0

    Share this video

    Uri Rolls in blue and Thomas Wolf wearing glasses and an off-white shirt flank the blue and white “AI CYBER DEFENSE” headline on black. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 24 July 2026 and duration 17m 28s.

    Uri Rolls and Thomas Wolf argue that realistic black-box benchmarks and specialized open models can help defenders keep pace with AI-assisted attackers.