LeCunn
Interview with Lex Fridman March 2024 (YouTube)
Analogy with ball point pens: OMG people could write horrible things! Doomers: regulate ball pens now! Pencil makers: ball pens are dangerous. Governments should require a license for pens
Joscha Bach tweet: “Whether the pod bay doors should be opened or closed is a complex issue”
AGI won’t happen in a single event. It’ll be gradual, with plenty of time to insert guardrails.
Podcast Outline
OUTLINE: 0:00 - Introduction 2:18 - Limits of LLMs 13:54 - Bilingualism and thinking 17:46 - Video prediction 25:07 - JEPA (Joint-Embedding Predictive Architecture) 28:15 - JEPA vs LLMs 37:31 - DINO and I-JEPA 38:51 - V-JEPA 44:22 - Hierarchical planning 50:40 - Autoregressive LLMs 1:06:06 - AI hallucination 1:11:30 - Reasoning in AI 1:29:02 - Reinforcement learning 1:34:10 - Woke AI 1:43:48 - Open source 1:47:26 - AI and ideology 1:49:58 - Marc Andreesen 1:57:56 - Llama 3 2:04:20 - AGI 2:08:48 - AI doomers 2:24:38 - Joscha Bach 2:28:51 - Humanoid robots 2:38:00 - Hope for the future