Why Large? Tiny LMs & Agents on Edge/Robotics - Cormac Brick, Google

AI Engineer21m 45s
Cormac Brick against a black background beside the blue and white headline “TINY MODELS / MORE DEVICES”.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Google AI Edge engineer Cormac Brick contrasts cloud inferenceInference is the use of a trained model to produce an output from supplied input. with local intelligence that can work offline, preserve data on the device and provide predictable latency. Memory cost and the wider range of target hardware constrain deployment: fitting model weights is only part of the budget once the runtime, cache and operating system are included.

    Brick compares general small models with much smaller specialists for speech, vision, embeddings and function callingAI tool calling lets a model request a structured operation from software instead of only returning natural-language text.. He reports hardware-dependent performance and demonstrates why merely running a model is not enough if an interaction feels too slow. The transcript's contradictory tiny-model parameter phrase is not adopted as a technical specification.

    Task-specific fine-tuningFine-tuning adapts a pretrained model by updating its parameters on examples chosen for a particular task or subject. with synthetic dataSynthetic data is information generated to represent examples or situations rather than collected directly from the events it describes. is presented as a route to compact, responsive features. Examples include voice commands mapped to a fixed set of functions and offline dictation using separate speech-recognitionAutomatic speech recognition converts spoken language into text or structured linguistic output using signal processing and machine learning. and text-polishing models. Brick treats easier customization and faster visual perception as future work; reported reliability remains specific to the demonstrated tasks.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows25
    • Coding & tools25
    • Models & learning75
    • Infrastructure & compute100
    • Research & evaluation25
    • Safety & security25
    • Business & productivity0
    • Creative & media0
    • Robotics & perception50
    • Society & policy0

    Share this video

    Cormac Brick against a black background beside the blue and white headline “TINY MODELS / MORE DEVICES”. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 25 July 2026 and duration 21m 45s.

    Smaller models can put useful AI on more devices. Cormac Brick explains how memory budgets, quantization and narrow task training shape practical edge and robotics deployments.