The Narrow Window to AGI

Dwarkesh Patel · Intermediate ·🛡️ AI Safety & Ethics ·2y ago

Key Takeaways

The video discusses the concept of achieving Artificial General Intelligence (AGI) and the potential limitations of current large language models like GPT-7, with the speaker arguing that even with significant increases in parameter count, we are still far from reaching brain-scale intelligence.

Full Transcript

do you buy the framing that given that you have to be two orders of magnitude bigger at every generation if you don't get AGI by gpt7 that can help you catapult an intelligence explosion you're kind of just [ __ ] as far as like much smarter intelligences go and you're kind of stuck with gpt7 level models for a long time gbd4 cost $100 million or whatever you have what the 1B run the 10B run the 100b run all seem very plausible by private company standards you can also Imagine even like a ont run being part of like a national Consortium I want to point out the one we have a lot more jumps and even if those jumps are relatively smaller that's still a pretty Stark Improvement of capability not only that but if you believe claims that GPT 4 is around 1 trillion parameter count the human brain is between 30 and 300 trillion copses and so that's obviously not a onetoone mapping and and we can debate the numbers but it seems pretty plausible that we're below brain scale still
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Dwarkesh Patel · Dwarkesh Patel · 0 of 60

← Previous Next →
1 Rubik's Cube Encryption Demo
Rubik's Cube Encryption Demo
Dwarkesh Patel
2 Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
3 Matjaž Leonardis - Science, Identity and Probability
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
4 Robin Hanson - The Long View and The Elephant in the Brain
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
5 Caleb Watney - America's Innovation Engine
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
6 Alex Tabarrok - Prizes, Prices, and Public Goods
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
7 Scott Young - Ultralearning, The MIT Challenge
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
8 Scott Aaronson - Quantum Computing, Complexity, and Creativity
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
9 Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
10 Michael Huemer - Anarchy, Capitalism, and Progress
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
11 Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
12 Byrne Hobart - Optionality, Stagnation, and Secret Societies
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
13 David Deutsch - AI, America, Fun, & Bayes
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
14 Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
15 Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
16 Razib Khan - Genomics, Intelligence, and The Church of Science
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
17 Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
18 Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
19 Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
20 Agustin Lebron - Trading, Crypto, and Adverse Selection
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
21 Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
22 Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
23 Sam Bankman-Fried On FOCUS
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
24 Sam Bankman-Fried on GREAT FOUNDERS
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
25 $30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
26 Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
27 Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
28 Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
29 Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
30 Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
31 Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
32 Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
33 Bryan Caplan - Feminists, Billionaires, and Demagogues
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
34 Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
35 Kenneth T. Jackson - Robert Moses, Hero of New York?
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
36 Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
37 Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
38 Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
39 Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
40 Holden Karnofsky — History's most important century
Holden Karnofsky — History's most important century
Dwarkesh Patel
41 $30m Grant to OpenAI?
$30m Grant to OpenAI?
Dwarkesh Patel
42 Does GPT Have Holden Worried?
Does GPT Have Holden Worried?
Dwarkesh Patel
43 Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
44 Deep Learning Changes Everything
Deep Learning Changes Everything
Dwarkesh Patel
45 Garett Jones — Immigration, national IQ, & less democracy
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
46 Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
47 Why You Shouldn't Start A Startup
Why You Shouldn't Start A Startup
Dwarkesh Patel
48 The Future Of Venture Capital
The Future Of Venture Capital
Dwarkesh Patel
49 The Crucial Skill For A Startup Founder
The Crucial Skill For A Startup Founder
Dwarkesh Patel
50 Brett Harrison — FTX US former president speaks out
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
51 Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
52 Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
53 Impact of Taiwan Invasion on AI
Impact of Taiwan Invasion on AI
Dwarkesh Patel
54 Reliability is Bottleneck on AI - OpenAI Founder
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
55 Next Token Prediction SOLVES AI Says OpenAI Founder
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
56 Harmful Uses of GPT - OpenAI Founder
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
57 Why OpenAI Founder Thinks AI Is Near
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
58 AI will help us achieve enlightenment -  OpenAI Founder
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
59 Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
60 Richard Rhodes — The making of the atomic bomb
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel

The video discusses the potential limitations of current large language models in achieving Artificial General Intelligence (AGI) and the importance of considering the challenges and risks associated with developing more advanced AI systems. The speaker argues that even with significant increases in parameter count, we are still far from reaching brain-scale intelligence.

Key Takeaways
  1. Understand the concept of AGI and its potential implications
  2. Analyze the limitations of current LLMs like GPT-7
  3. Consider the challenges of scaling up parameter count to achieve brain-scale intelligence
  4. Evaluate the potential risks and benefits of developing more advanced AI systems
💡 The current pace of progress in LLMs may not be sufficient to achieve AGI in the near future, and significant technical and ethical challenges need to be addressed.

Related Reads

📰
Elon Musk’s Grok Faces a Trust Crisis After Developers Flag a Major Privacy Concern
Grok, an AI project by Elon Musk, faces a trust crisis due to a major privacy concern flagged by developers, highlighting the importance of prioritizing user privacy in AI development
Reddit r/artificial
📰
FullAgenticStack: Semantic Behavior Type: LinearAutoDestroy
Learn to identify and prevent security bugs and failures caused by incorrect assumptions in AI systems, particularly in the context of the FullAgenticStack and its LinearAutoDestroy type
Dev.to · suissAI
📰
Texas AI Law Compliance: A Guide for Businesses
Learn how to comply with Texas's TRAIGA law to avoid discrimination risks and ensure regulatory compliance in AI business practices
Hackernoon
📰
An AI Science Workbench Needs a Reproducibility Graph, Not Just Chat History
Learn how a reproducibility graph can improve AI science workbenches by tracking datasets, code, and environments for better collaboration and transparency
Dev.to · Robin
Up next
Google I/O Revealed This Critical AI Security Flaw
SCALER
Watch →