AI Is Learning at the Wrong Level of Abstraction - Matthieu Wyart

Machine Learning Street Talk1h 18m
Portraits of Tim Scarfe and Matthieu Wyart beside the words Predict Latents
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Wyart connects statistical physics with deep learningDeep learning uses neural networks with many layers to learn representations from data. by treating intelligence as the discovery of useful large-scale variables hidden inside high-dimensional data. When observations have a hierarchical structure, deeper networks can build successive abstractions more efficiently than shallow models that try to represent every interaction at once.

    The discussion links this hierarchy to the curse of dimensionalityThe curse of dimensionality describes problems that become harder as the number of independent variables increases., language and creativity. Wyart argues that useful generalizationGeneralization is an AI system's ability to apply what it learned to new examples and conditions that were not part of its training experience. depends on finding lower-dimensional structure and recombining learned patterns, rather than memorizing every possible configuration of the world.

    He proposes predicting learned latent representationsA latent representation is an internal numerical encoding an AI model uses to represent and process information. instead of raw sensory detail as a route to greater sample efficiencySample efficiency measures how much useful learning an AI system achieves from a given number of training examples or experiences.. The theory is still being tested empirically, and reconstructing rich observations from those abstract representations remains an open generative problem.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows0
    • Coding & tools0
    • Models & learning100
    • Infrastructure & compute0
    • Research & evaluation88
    • Safety & security0
    • Business & productivity0
    • Creative & media20
    • Robotics & perception0
    • Society & policy0

    Share this video

    Portraits of Tim Scarfe and Matthieu Wyart beside the words Predict Latents With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 10 August 2026 and duration 1h 18m.

    Deep networks can recover hierarchical abstractions from data, while predicting learned latent representations may reduce the samples needed to acquire them.