Some thoughts on the Sutton interview

Dwarkesh Patel · Beginner ·🏗️ Systems Design & Architecture ·7mo ago
I have a much better understanding of Sutton’s perspective now. I wanted to reflect on it a bit. Read the transcript here: https://www.dwarkesh.com/p/thoughts-on-sutton TIMESTAMPS 00:00:00 The steelman 00:02:42 TLDR of my current thoughts 00:03:22 Imitation learning is continuous with and complementary to RL 00:08:26 Continual learning 00:10:31 Concluding thoughts
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Dwarkesh Patel · Dwarkesh Patel · 0 of 60

← Previous Next →
1 Rubik's Cube Encryption Demo
Rubik's Cube Encryption Demo
Dwarkesh Patel
2 Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
3 Matjaž Leonardis - Science, Identity and Probability
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
4 Robin Hanson - The Long View and The Elephant in the Brain
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
5 Caleb Watney - America's Innovation Engine
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
6 Alex Tabarrok - Prizes, Prices, and Public Goods
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
7 Scott Young - Ultralearning, The MIT Challenge
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
8 Scott Aaronson - Quantum Computing, Complexity, and Creativity
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
9 Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
10 Michael Huemer - Anarchy, Capitalism, and Progress
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
11 Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
12 Byrne Hobart - Optionality, Stagnation, and Secret Societies
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
13 David Deutsch - AI, America, Fun, & Bayes
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
14 Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
15 Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
16 Razib Khan - Genomics, Intelligence, and The Church of Science
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
17 Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
18 Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
19 Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
20 Agustin Lebron - Trading, Crypto, and Adverse Selection
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
21 Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
22 Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
23 Sam Bankman-Fried On FOCUS
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
24 Sam Bankman-Fried on GREAT FOUNDERS
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
25 $30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
26 Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
27 Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
28 Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
29 Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
30 Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
31 Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
32 Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
33 Bryan Caplan - Feminists, Billionaires, and Demagogues
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
34 Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
35 Kenneth T. Jackson - Robert Moses, Hero of New York?
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
36 Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
37 Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
38 Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
39 Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
40 Holden Karnofsky — History's most important century
Holden Karnofsky — History's most important century
Dwarkesh Patel
41 $30m Grant to OpenAI?
$30m Grant to OpenAI?
Dwarkesh Patel
42 Does GPT Have Holden Worried?
Does GPT Have Holden Worried?
Dwarkesh Patel
43 Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
44 Deep Learning Changes Everything
Deep Learning Changes Everything
Dwarkesh Patel
45 Garett Jones — Immigration, national IQ, & less democracy
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
46 Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
47 Why You Shouldn't Start A Startup
Why You Shouldn't Start A Startup
Dwarkesh Patel
48 The Future Of Venture Capital
The Future Of Venture Capital
Dwarkesh Patel
49 The Crucial Skill For A Startup Founder
The Crucial Skill For A Startup Founder
Dwarkesh Patel
50 Brett Harrison — FTX US former president speaks out
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
51 Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
52 Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
53 Impact of Taiwan Invasion on AI
Impact of Taiwan Invasion on AI
Dwarkesh Patel
54 Reliability is Bottleneck on AI - OpenAI Founder
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
55 Next Token Prediction SOLVES AI Says OpenAI Founder
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
56 Harmful Uses of GPT - OpenAI Founder
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
57 Why OpenAI Founder Thinks AI Is Near
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
58 AI will help us achieve enlightenment -  OpenAI Founder
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
59 Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
60 Richard Rhodes — The making of the atomic bomb
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel

Related AI Lessons

Modular Monolith vs Microservices in NestJS
Learn to scale your NestJS application with modular monolith and microservices architectures
Dev.to · Geampiere Jaramillo
What Breaks When Platform-Specific Publishing Steps Stop Sharing the Same Assumptions: Practical Notes for Builders
Learn how to identify and address workflow breakdowns in platform-specific publishing steps beyond the draft stage
Dev.to AI
Proto-Synth Grid Engine: Building a Math-First 2D World Runtime That Feels 3D
Learn how Proto-Synth Grid Engine creates a 2D world that feels 3D using math-first simulation and blueprint-driven design
Dev.to · Gary Doman/TizWildin
ACID vs BASE Transactions
Learn the difference between ACID and BASE transaction models and how to choose the right one for your database needs
Dev.to · 丁久

Chapters (5)

The steelman
2:42 TLDR of my current thoughts
3:22 Imitation learning is continuous with and complementary to RL
8:26 Continual learning
10:31 Concluding thoughts
Up next
How can I make sure that my Traffic Mirroring data reaches my destination instance in Amazon VPC?
Amazon Web Services
Watch →