Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary
Skills:
Reading ML Papers70%
Gwern's blog: https://gwern.net/. Gwern is a pseudonymous researcher and writer. After the episode, I convinced Gwern to create a donation page where people can help sustain what he's up to. Please go here to contribute: https://donate.stripe.com/6oE9DTgaf6oD0M03cc. Thank you to my friend Chris Painter for doing an amazing job voice acting Gwern.
𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒
* Jane Street is looking to hire their next generation of leaders. Their deep learning team is looking for ML researchers, FPGA programmers, and CUDA programmers. Summer internships are open - if you want to stand out, take a crack at their new Kaggle competition. To learn more, go here: https://jane-st.co/dwarkesh
* Turing provides complete post-training services for leading AI labs like OpenAI, Anthropic, Meta, and Gemini. They specialize in model evaluation, SFT, RLHF, and DPO to enhance models’ reasoning, coding, and multimodal capabilities. Learn more at https://turing.com/dwarkesh.
* This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more here: https://stripe.com/
𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒
* Transcript: https://www.dwarkeshpatel.com/p/gwern-branwen
* Me on Twitter: https://twitter.com/dwarkesh_sp
* Spotify: https://open.spotify.com/episode/46H5dTtYaj1L55UAy9XXaY?si=xVoj6euwQdmZYnyvaQ46lA
𝐓𝐈𝐌𝐄𝐒𝐓𝐀𝐌𝐏𝐒
00:00:00 - Anonymity
00:01:09 - Automating Steve Jobs
00:04:38 - Isaac Newton's theory of progress
00:06:36 - Grand theory of intelligence
00:10:39 - Seeing scaling early
00:21:04 - AGI Timelines
00:22:54 - What to do in remaining 3 years until AGI
00:26:29 - Influencing the shoggoth with writing
00:30:50 - Human vs artificial intelligence
00:33:52 - Rabbit holes
00:38:48 - Hearing impairment
00:43:00 - Wikipedia editing
00:47:43 - Gwern.net
00:50:20 - Counterfactual careers
00:54:30 - Borges & literature
01:01:32 - Gwern's
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Dwarkesh Patel · Dwarkesh Patel · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Rubik's Cube Encryption Demo
Dwarkesh Patel
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
Holden Karnofsky — History's most important century
Dwarkesh Patel
$30m Grant to OpenAI?
Dwarkesh Patel
Does GPT Have Holden Worried?
Dwarkesh Patel
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
Deep Learning Changes Everything
Dwarkesh Patel
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
Why You Shouldn't Start A Startup
Dwarkesh Patel
The Future Of Venture Capital
Dwarkesh Patel
The Crucial Skill For A Startup Founder
Dwarkesh Patel
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
Impact of Taiwan Invasion on AI
Dwarkesh Patel
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel
More on: Reading ML Papers
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
The ABCs of reading medical research and review papers these days
Medium · LLM
#1 DevLog Meta-research: I Got Tired of Tab Chaos While Reading Research Papers.
Dev.to AI
How to Set Up a Karpathy-Style Wiki for Your Research Field
Medium · AI
The Non-Optimality of Scientific Knowledge: Path Dependence, Lock-In, and The Local Minimum Trap
ArXiv cs.AI
Chapters (16)
Anonymity
1:09
Automating Steve Jobs
4:38
Isaac Newton's theory of progress
6:36
Grand theory of intelligence
10:39
Seeing scaling early
21:04
AGI Timelines
22:54
What to do in remaining 3 years until AGI
26:29
Influencing the shoggoth with writing
30:50
Human vs artificial intelligence
33:52
Rabbit holes
38:48
Hearing impairment
43:00
Wikipedia editing
47:43
Gwern.net
50:20
Counterfactual careers
54:30
Borges & literature
1:01:32
Gwern's
🎓
Tutor Explanation
DeepCamp AI