Nemotron 3.5 Lightning First Test - NVIDIA's Newest Open Model

Bijan Bowen29m 24s
Bijan Bowen in a red hoodie beside NEMOTRON BUILT FOR AGENTS, with AGENTS in matching red, on a black background.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Bijan Bowen tests Nemotron 3.5 Lightning, a 30-billion-parameter mixture-of-experts modelA mixture-of-experts model contains multiple specialized subnetworks and activates a selected subset for each input instead of using every parameter every time. with roughly three billion active parameters, a Mamba 2 architecture and a one-million-token context windowA context window is the maximum amount of tokenized information an AI model can consider during one processing session.. The model runs quickly on local hardwareOn-device inference runs a trained model on the user's device rather than relying entirely on a remote model service. and is designed to use speculative decodingSpeculative decoding accelerates text generation by proposing several tokens cheaply and checking them together with the target model. for higher throughput.

    In coding and browser-driven tasks, Bijan Bowen finds uneven results. Nemotron 3.5 Lightning can install dependencies, call tools and keep working through an agent loop, but its games, visual interfaces and browser interactions often need intervention or remain incomplete.

    Long-context retrievalRetrieval is the process of selecting relevant stored information and returning it to an AI system for the current task. is the clearer strength. Bijan Bowen gives the model a document of roughly 60,000 tokens and sees it recover a requested detail accurately, supporting its use for large repositories, document sets and agent memory where recall matters more than polished front-end output.

    Bijan Bowen concludes that Nemotron 3.5 Lightning is not a coding powerhouse, but its speed, tool use, personality and large context window make it a useful local workhorse for agentic tasks that can tolerate supervision.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows85
    • Coding & tools65
    • Models & learning85
    • Infrastructure & compute70
    • Research & evaluation100
    • Safety & security0
    • Business & productivity20
    • Creative & media15
    • Robotics & perception0
    • Society & policy0

    Share this video

    Bijan Bowen in a red hoodie beside NEMOTRON BUILT FOR AGENTS, with AGENTS in matching red, on a black background. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 12 August 2026 and duration 29m 24s.

    Bijan Bowen finds Nemotron 3.5 Lightning more convincing as a fast, long-context agent model than as a polished coding or visual-development model.