#70 – LETITIA PARCALABESCU – Symbolics, Linguistics [UNPLUGGED]

Today we are having a discussion with Letitia Parcalabescu from the AI Coffee Break youtube channel! We discuss linguistics, symbolic AI and our respective Youtube channels. Make sure you subscribe to her channel! In the first 15 minutes Tim dissects the recent article from Gary Marcus “Deep learning has hit a wall”.

Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB
Pod: https://anchor.fm/machinelearningstreettalk/episodes/70—LETITIA-PARCALABESCU—Symbolics–Linguistics-UNPLUGGED-e1fuqas

[00:00:00] Comments on Gary Marcus Article / Symbolic AI
[00:14:57] Greetings
[00:17:40] Introduction
[00:18:48] A shared journey towards computation
[00:22:10] A linguistics outsider
[00:24:11] Is computational linguistics AI?
[00:28:23] swinging pendulums of dogma and resource allocation
[00:31:16] the road less travelled
[00:34:35] pitching grants with multimodality … and then the truth
[00:40:50] some aspects of language are statistically learnable
[00:44:58] … and some aspects of language are dimensionally cursed
[00:48:24] it’s good to have both approaches to machine intelligence
[00:51:14] the world runs on symbols
[00:54:28] there is much more to learn biology
[00:59:26] Letitia’s creation process
[01:02:23] don’t overfit content, instead publish and iterate
[01:07:48] merging the big picture arrow from the small direction arrows
[01:11:02] use passion to drive through failure to success
[01:12:56] stay positive
[01:16:02] closing remarks

AI Coffee Break with Letitia
https://www.youtube.com/c/AICoffeeBreak

References;
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 [Bender et al]
https://dl.acm.org/doi/10.1145/3442188.3445922

On the Measure of Intelligence [Chollet]
https://arxiv.org/pdf/1911.01547.pdf

Deep Learning Is Hitting a Wall [Marcus]

Deep Learning Is Hitting a Wall

Intellectual issues in the history of artificial intelligence [Newell, 82]
https://apps.dtic.mil/sti/pdfs/ADA125318.pdf

Neurosymbolic AI: The 3rd Wave [Garcez, Lamb]
https://arxiv.org/abs/2012.05876

Melanie Mitchell tweet

Symbolic Behaviour in Artificial Intelligence [Santoro, Lampinen et al]
https://arxiv.org/abs/2102.03406

The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence [Marcus]
https://arxiv.org/abs/2002.06177

YouTube Source for this AI Video

AI video(s) you might be interested in …