We Finally Know What Ilya Is Working On...
Ilya Sutskever argues that AI needs a more sample-efficient path to generalization because larger pretraining runs alone do not close the gap with human learning.
Generalization
Videos about whether AI systems can transfer learned capabilities to unfamiliar tasks, settings, and forms of reasoning. 1 video.