Terence Tao – Kepler, Newton, and the true nature of mathematical discovery
We begin the episode with the absolutely ingenious and surprising way in which Kepler discovered the laws of planetary motion.
People sometimes say that AI will make especially fast progress at scientific discovery because of tight verification loops. But the story of how we discovered the shape of our solar system shows how the verification loop for correct ideas can be decades (or even millennia) long.
During this time, what we know today as the better theory can often actually make worse predictions (Copernicus's model of circular orbits around the sun was actually less accurate than Ptolemy's geocentric model). And the reasons it survives this epistemic hell is some mixture of judgment and heuristics that we don’t even understand well enough to actually articulate, much less codify into an RL loop.
Hope you enjoy!
𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒
* Transcript: https://www.dwarkesh.com/p/terence-tao
* Apple Podcasts: https://podcasts.apple.com/us/podcast/terence-tao-kepler-newton-and-the-true/id1516093381?i=1000756353875
* Spotify: https://open.spotify.com/episode/24xF8YGra2w3HXZYbhgVKU?si=U5V-SgvSQ8eVIcG2Z86wfQ
𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒
- Jane Street loves challenging my audience with different creative puzzles. One of my listeners, Shawn, solved Jane Street’s ResNet challenge and posted a great walk-through on X (https://x.com/hynwprk/status/2026376546286711206). If you want to try one of these puzzles yourself, there’s one live now at https://janestreet.com/dwarkesh
- Labelbox can get you rubric-based evals, no matter your domain. These rubrics allow you to give your model feedback on all the dimensions you care about, so you can train how it thinks, not just what it thinks. Whatever you’re focused on—math, physics, finance, psychology or something else—Labelbox can help. Learn more at https://labelbox.com/dwarkesh
- Mercury just released a new feature called Insights. Insights summarizes your money in and out, showing you your biggest transactions and calling out anythi
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Dwarkesh Patel · Dwarkesh Patel · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Rubik's Cube Encryption Demo
Dwarkesh Patel
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
Holden Karnofsky — History's most important century
Dwarkesh Patel
$30m Grant to OpenAI?
Dwarkesh Patel
Does GPT Have Holden Worried?
Dwarkesh Patel
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
Deep Learning Changes Everything
Dwarkesh Patel
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
Why You Shouldn't Start A Startup
Dwarkesh Patel
The Future Of Venture Capital
Dwarkesh Patel
The Crucial Skill For A Startup Founder
Dwarkesh Patel
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
Impact of Taiwan Invasion on AI
Dwarkesh Patel
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel
More on: Reading ML Papers
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
The ABCs of reading medical research and review papers these days
Medium · LLM
#1 DevLog Meta-research: I Got Tired of Tab Chaos While Reading Research Papers.
Dev.to AI
How to Set Up a Karpathy-Style Wiki for Your Research Field
Medium · AI
The Non-Optimality of Scientific Knowledge: Path Dependence, Lock-In, and The Local Minimum Trap
ArXiv cs.AI
🎓
Tutor Explanation
DeepCamp AI