We Vetted 2000 AI Skills Before They Reached Developers - Lucas Palma, Nubank

AI Engineer16m 24s
Lucas Palma in a blue shirt beside the headline “VETTING 2,000 AI SKILLS” on a black background.
1 VIEW
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Lucas Palma argues that AI skillsAn AI agent skill is a reusable package of instructions, resources, and tool guidance for performing a bounded kind of work. behave like supply-chain dependencies because their instructions can shape another developer's generated code. He identifies credential exposure, destructive shell commands and overly broad permissions as risks that a code-only reviewCode review examines proposed source changes to assess their correctness, clarity and suitability before or around integration. can miss.

    At Nubank, a proposed skill moves through an internal marketplace gate. Developers can scan locally, then CI repeats checks after a pull request. Deterministic rules and LLM reviewSecurity testing checks whether software controls protect systems and information in defined scenarios. feed pull request comments and machine-readable findings, after which policy determines whether to allow, remediate or block the skill.

    Lucas Palma reports that the team scanned more than 2,000 skills and found more than 1,500 risks, with some blocked before marketplace distribution. His lessons include weighing commands by context, enforcing human approval through actual tool gatesHuman-in-the-loop command approval requires a person to review and authorize a consequential AI action before it executes. rather than prompt text alone, and extending the controls to plugins, agent rules and MCP serversModel Context Protocol is a standard way for AI applications to connect to external tools and sources of context..

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows100
    • Coding & tools75
    • Models & learning10
    • Infrastructure & compute25
    • Research & evaluation25
    • Safety & security100
    • Business & productivity25
    • Creative & media0
    • Robotics & perception0
    • Society & policy0

    Share this video

    Lucas Palma in a blue shirt beside the headline “VETTING 2,000 AI SKILLS” on a black background. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 29 July 2026 and duration 16m 24s.

    Lucas Palma describes how Nubank treats AI skills as supply-chain inputs and scans them locally and in CI before developers share them through an internal marketplace.