Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence

Dwarkesh Patel · Advanced ·📰 AI News & Updates ·3y ago
Asked Ilya Sutskever (Chief Scientist of OpenAI) about: * time to AGI * leaks and spies * what's after generative models * post AGI futures * working with MSFT and competing with Google * difficulty of aligning superhuman AI Hope you enjoy as much as I did! 𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒 * Transcript: https://www.dwarkeshpatel.com/p/ilya-sutskever * Apple Podcasts: https://apple.co/42H6c4D * Spotify: https://spoti.fi/3LRqOBd * Follow me on Twitter: https://twitter.com/dwarkesh_sp 𝐓𝐈𝐌𝐄𝐒𝐓𝐀𝐌𝐏𝐒 00:00:00 - Time to AGI 00:05:57 - What’s after generative models? 00:10:57 - Data, models, and research 00:15:27 - Alignment 00:20:53 - Post AGI Future 00:26:56 - New ideas are overrated 00:36:22 - Is progress inevitable? 00:41:27 - Future Breakthroughs
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Dwarkesh Patel · Dwarkesh Patel · 52 of 60

← Previous Next →
1 Rubik's Cube Encryption Demo
Rubik's Cube Encryption Demo
Dwarkesh Patel
 2 Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
 3 Matjaž Leonardis - Science, Identity and Probability
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
 4 Robin Hanson - The Long View and The Elephant in the Brain
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
 5 Caleb Watney - America's Innovation Engine
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
 6 Alex Tabarrok - Prizes, Prices, and Public Goods
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
 7 Scott Young - Ultralearning, The MIT Challenge
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
 8 Scott Aaronson - Quantum Computing, Complexity, and Creativity
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
 9 Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
 10 Michael Huemer - Anarchy, Capitalism, and Progress
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
 11 Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
 12 Byrne Hobart - Optionality, Stagnation, and Secret Societies
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
 13 David Deutsch - AI, America, Fun, & Bayes
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
 14 Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
 15 Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
 16 Razib Khan - Genomics, Intelligence, and The Church of Science
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
 17 Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
 18 Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
 19 Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
 20 Agustin Lebron - Trading, Crypto, and Adverse Selection
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
 21 Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
 22 Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
 23 Sam Bankman-Fried On FOCUS
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
 24 Sam Bankman-Fried on GREAT FOUNDERS
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
 25 $30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
 26 Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
 27 Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
 28 Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
 29 Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
 30 Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
 31 Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
 32 Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
 33 Bryan Caplan - Feminists, Billionaires, and Demagogues
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
 34 Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
 35 Kenneth T. Jackson - Robert Moses, Hero of New York?
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
 36 Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
 37 Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
 38 Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
 39 Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
 40 Holden Karnofsky — History's most important century
Holden Karnofsky — History's most important century
Dwarkesh Patel
 41 $30m Grant to OpenAI?
$30m Grant to OpenAI?
Dwarkesh Patel
 42 Does GPT Have Holden Worried?
Does GPT Have Holden Worried?
Dwarkesh Patel
 43 Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
 44 Deep Learning Changes Everything
Deep Learning Changes Everything
Dwarkesh Patel
 45 Garett Jones — Immigration, national IQ, & less democracy
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
 46 Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
 47 Why You Shouldn't Start A Startup
Why You Shouldn't Start A Startup
Dwarkesh Patel
 48 The Future Of Venture Capital
The Future Of Venture Capital
Dwarkesh Patel
 49 The Crucial Skill For A Startup Founder
The Crucial Skill For A Startup Founder
Dwarkesh Patel
 50 Brett Harrison — FTX US former president speaks out
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
 51 Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
 ▶ Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
 53 Impact of Taiwan Invasion on AI
Impact of Taiwan Invasion on AI
Dwarkesh Patel
 54 Reliability is Bottleneck on AI - OpenAI Founder
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
 55 Next Token Prediction SOLVES AI Says OpenAI Founder
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
 56 Harmful Uses of GPT - OpenAI Founder
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
 57 Why OpenAI Founder Thinks AI Is Near
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
 58 AI will help us achieve enlightenment - OpenAI Founder
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
 59 Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
 60 Richard Rhodes — The making of the atomic bomb
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel

Related AI Lessons

⚡
Meta Is in Crisis, Google Search’s Makeover, and AI Gets Booed by Graduates
Learn about Meta's crisis, Google Search's makeover, and AI's backlash from graduates, and how these events impact the tech industry
Wired AI
 ⚡
What I Do Between Biotech Jobs, Part 1: The 20-Line Script That Outsmarted an AI
Learn how a 20-line script outsmarted an AI in biotech, and discover the potential of creative problem-solving in the industry
Medium · AI
 ⚡
Spotify and Universal Music strike deal allowing fan-made AI covers and remixes
Spotify and Universal Music partner to allow fan-made AI covers and remixes, with revenue sharing for artists
TechCrunch AI
 ⚡
Google Just Turned Search Into Something It Has Never Been Before
Google Search has undergone a significant transformation after 25 years, leveraging AI to change its core functionality
Medium · AI

Chapters (8)

Time to AGI
5:57 What’s after generative models?
10:57 Data, models, and research
15:27 Alignment
20:53 Post AGI Future
26:56 New ideas are overrated
36:22 Is progress inevitable?
41:27 Future Breakthroughs
Up next
OpenAI: $2M in tokens to every YC company in the spring and summer batches.
Y Combinator
Watch →