Robert Lange on NN Pruning and Collective Intelligence
We speak with Robert Lange!
Robert is a PhD student at the Technical University Berlin. His research combines Deep Multi-Agent Reinforcement Learning and Cognitive Science to study the learning dynamics of large collectives. He has a brilliant blog where he distils and explains cutting edge ML research. We spoke about his story, economics, multi-agent RL, intelligence and AGI, and his recent article summarising the state of the art in neural network pruning.
Robert’s article on pruning in NNs https://roberttlange.github.io/posts/2020/06/lottery-ticket-hypothesis/
00:04:17 Show start and intro to Robert
00:11:39 Economics background
00:27:20 Intrinsic motivation
00:48:16 Lottery ticket/pruning article discussion
01:43:21 Robert’s advice for younger self and state of deep learning
Robert’s LinkedIn: https://www.linkedin.com/in/robert-tjarko-lange-19539a12a/