What Mark Zuckerberg learned from Caesar Augustus

Dwarkesh Patel · Beginner ·🧠 Large Language Models ·2y ago

Key Takeaways

Mark Zuckerberg's learnings from Caesar Augustus, open-sourcing LLaMA models, and the importance of adapting to new ideas in tech and business

Full Transcript

so the 19yearold Mark um reads a bunch of like Antiquity and Classics uh High School College what important lesson did you learn from it not just interesting things you found but like there aren't that many tokens who consume by the time you're 19 a bunch of them were about the classics clearly that was important in some way tokens you cons I mean one of the things I thought was really fascinating is um so when Augustus was first so he he became emperor and um and he was trying to establish peace and there was no real conception of Peace at the time like the people's people's understanding of Peace was it is the temporary time between when your enemies will inevitably attack you again so you get like a short rest and and he had this view which is like look like we want to change the economy from instead of being so mercenary and like and kind of militaristic to like actually this positive some thing it's like a very novel idea the time I think that that there's like something that's just really fundamental about that it's like in terms of the the bounds on like what people can conceive at the time of like what are rational ways to work and um I don't know I going back to like I this applies to both the metaverse and the AI stuff but like a lot of investors and just different people just can't wrap their head around why we would open source this like I don't understand it's like open source that must just be like the temporary time between which you're making things propri but but I actually think it's like this very profound thing in Tech that creates a lot of winners right and it's and and um so I don't know I don't want to strain the analogy too much but but I do think that there's there's a lot of times I think ways where you can that are just like models for building things that people can't even like they just like often can't wrap their head around how that would be a valuable thing for people to go do or like a reasonable state of the world that I think there's more reasonable things than people think that's super fascinating um can I give you my answer what I was thinking you might have gotten from it um this is probably totally off but um just how young some of these people are who have very important roles in the Empire like Caesar Augustus like by the time he's 19 he's actually incredibly one of the most prominent people in Roman politics and he's like leading battles and forming the second tribe M at I wonder if you're like the 19-year-old is like I can actually do this because like I think that's an interesting example both from a lot of history and American history too I mean one of my favorite quotes is it's this Picasso quote that all children are artists and the challenge is how do you remain an artist when you grow up and it's like basically I think because when you're younger I think it's just easier to have kind of wild ideas and you're not you know you have no there are all these analogies to the innovators dilemma that exist in your life as well as your company or whatever you've built right so you know you're kind of earlier on your trajectory it's easier to Pivot and take in new ideas without it disrupting other commitments that you've made to to different things and um so I don't know I think that that's an interesting part of of running a company is like how do you how do you kind of stay dynamic

Original Description

Full Episode: https://youtu.be/bc6uFV9CJGg Apple Podcasts: https://podcasts.apple.com/us/podcast/mark-zuckerberg-llama-3-open-sourcing-%2410b-models-caeser/id1516093381?i=1000652877239 Spotify: https://open.spotify.com/episode/6Lbsk4HtQZfkJ4dZjh7E7k?si=GOqj7hUdSaWSgi7ULWXjMA Transcript: https://www.dwarkeshpatel.com/p/mark-zuckerberg Me on Twitter: https://twitter.com/dwarkesh_sp
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Dwarkesh Patel · Dwarkesh Patel · 0 of 60

← Previous Next →
1 Rubik's Cube Encryption Demo
Rubik's Cube Encryption Demo
Dwarkesh Patel
2 Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Bryan Caplan - Nurturing Orphaned Ideas, Education, and UBI
Dwarkesh Patel
3 Matjaž Leonardis - Science, Identity and Probability
Matjaž Leonardis - Science, Identity and Probability
Dwarkesh Patel
4 Robin Hanson - The Long View and The Elephant in the Brain
Robin Hanson - The Long View and The Elephant in the Brain
Dwarkesh Patel
5 Caleb Watney - America's Innovation Engine
Caleb Watney - America's Innovation Engine
Dwarkesh Patel
6 Alex Tabarrok - Prizes, Prices, and Public Goods
Alex Tabarrok - Prizes, Prices, and Public Goods
Dwarkesh Patel
7 Scott Young - Ultralearning, The MIT Challenge
Scott Young - Ultralearning, The MIT Challenge
Dwarkesh Patel
8 Scott Aaronson - Quantum Computing, Complexity, and Creativity
Scott Aaronson - Quantum Computing, Complexity, and Creativity
Dwarkesh Patel
9 Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Uncle Bob - The Long Reach of Code, Automating Programming, and Developing Coding Talent
Dwarkesh Patel
10 Michael Huemer - Anarchy, Capitalism, and Progress
Michael Huemer - Anarchy, Capitalism, and Progress
Dwarkesh Patel
11 Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Sarah Fitz-Claridge - Taking Children Seriously | The Lunar Society #15
Dwarkesh Patel
12 Byrne Hobart - Optionality, Stagnation, and Secret Societies
Byrne Hobart - Optionality, Stagnation, and Secret Societies
Dwarkesh Patel
13 David Deutsch - AI, America, Fun, & Bayes
David Deutsch - AI, America, Fun, & Bayes
Dwarkesh Patel
14 Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Bryan Caplan - Labor Econ, Poverty, & Mental Illness
Dwarkesh Patel
15 Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Jimmy Soni - Peter Thiel, Elon Musk, and the Paypal Mafia
Dwarkesh Patel
16 Razib Khan - Genomics, Intelligence, and The Church of Science
Razib Khan - Genomics, Intelligence, and The Church of Science
Dwarkesh Patel
17 Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Pradyu Prasad - Imperial Japan, the God Emperor, and Militarization in the Modern World
Dwarkesh Patel
18 Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Manifold Markets Founder - Predictions Markets & Revolutionizing Governance
Dwarkesh Patel
19 Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Ananyo Bhattacharya - John von Neumann, Jewish Genius, and Nuclear War
Dwarkesh Patel
20 Agustin Lebron - Trading, Crypto, and Adverse Selection
Agustin Lebron - Trading, Crypto, and Adverse Selection
Dwarkesh Patel
21 Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Sam Bankman-Fried - Crypto, FTX, Altruism, & Leadership
Dwarkesh Patel
22 Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Alexander Mikaberidze - Napoleon, War, Progress, and Global Order
Dwarkesh Patel
23 Sam Bankman-Fried On FOCUS
Sam Bankman-Fried On FOCUS
Dwarkesh Patel
24 Sam Bankman-Fried on GREAT FOUNDERS
Sam Bankman-Fried on GREAT FOUNDERS
Dwarkesh Patel
25 $30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
$30 BILLION Opportunity Ignored by Sam Bankman-Fried Competitors
Dwarkesh Patel
26 Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Dwarkesh Patel
27 Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Joseph Carlsmith - Utopia, AI, & Infinite Ethics
Dwarkesh Patel
28 Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Will MacAskill - Longtermism, Effective Altruism, History, & Technology
Dwarkesh Patel
29 Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Steve Hsu - Intelligence, Embryo Selection, & The Future of Humanity
Dwarkesh Patel
30 Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Austin Vernon - Energy Superabundance, Starship Missiles, & Finding Alpha
Dwarkesh Patel
31 Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Charles C. Mann - Americas Before Columbus & Scientific Wizardry
Dwarkesh Patel
32 Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Tyler Cowen - Why Society Will Collapse & Why Sex is Pessimistic
Dwarkesh Patel
33 Bryan Caplan - Feminists, Billionaires, and Demagogues
Bryan Caplan - Feminists, Billionaires, and Demagogues
Dwarkesh Patel
34 Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Brian Potter - Future of Construction, Ugly Modernism, & Environmental Review
Dwarkesh Patel
35 Kenneth T. Jackson - Robert Moses, Hero of New York?
Kenneth T. Jackson - Robert Moses, Hero of New York?
Dwarkesh Patel
36 Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Edward Glaeser - Cities, Terrorism, Housing, & Remote Work
Dwarkesh Patel
37 Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Byrne Hobart - FTX, Drugs, Twitter, Taiwan, & Monasticism
Dwarkesh Patel
38 Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Nadia Asparouhova — Tech elites, democracy, open source, & philanthropy
Dwarkesh Patel
39 Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Bethany McLean — Enron, FTX, 2008, Musk, frauds, & visionaries
Dwarkesh Patel
40 Holden Karnofsky — History's most important century
Holden Karnofsky — History's most important century
Dwarkesh Patel
41 $30m Grant to OpenAI?
$30m Grant to OpenAI?
Dwarkesh Patel
42 Does GPT Have Holden Worried?
Does GPT Have Holden Worried?
Dwarkesh Patel
43 Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Lars Doucet — Progress, poverty, Georgism, & why rent is too damn high
Dwarkesh Patel
44 Deep Learning Changes Everything
Deep Learning Changes Everything
Dwarkesh Patel
45 Garett Jones — Immigration, national IQ, & less democracy
Garett Jones — Immigration, national IQ, & less democracy
Dwarkesh Patel
46 Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Marc Andreessen — AI, crypto, 1000 Elon Musks, regrets, vulnerabilities, & managerial revolution
Dwarkesh Patel
47 Why You Shouldn't Start A Startup
Why You Shouldn't Start A Startup
Dwarkesh Patel
48 The Future Of Venture Capital
The Future Of Venture Capital
Dwarkesh Patel
49 The Crucial Skill For A Startup Founder
The Crucial Skill For A Startup Founder
Dwarkesh Patel
50 Brett Harrison — FTX US former president speaks out
Brett Harrison — FTX US former president speaks out
Dwarkesh Patel
51 Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
Dwarkesh Patel
52 Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Dwarkesh Patel
53 Impact of Taiwan Invasion on AI
Impact of Taiwan Invasion on AI
Dwarkesh Patel
54 Reliability is Bottleneck on AI - OpenAI Founder
Reliability is Bottleneck on AI - OpenAI Founder
Dwarkesh Patel
55 Next Token Prediction SOLVES AI Says OpenAI Founder
Next Token Prediction SOLVES AI Says OpenAI Founder
Dwarkesh Patel
56 Harmful Uses of GPT - OpenAI Founder
Harmful Uses of GPT - OpenAI Founder
Dwarkesh Patel
57 Why OpenAI Founder Thinks AI Is Near
Why OpenAI Founder Thinks AI Is Near
Dwarkesh Patel
58 AI will help us achieve enlightenment -  OpenAI Founder
AI will help us achieve enlightenment - OpenAI Founder
Dwarkesh Patel
59 Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality
Dwarkesh Patel
60 Richard Rhodes — The making of the atomic bomb
Richard Rhodes — The making of the atomic bomb
Dwarkesh Patel

Mark Zuckerberg learned valuable lessons from Caesar Augustus, including the importance of adapting to new ideas and open-sourcing models. This can be applied to modern business and tech, particularly in the development of LLaMA models and the metaverse.

Key Takeaways
  1. Read about Caesar Augustus and the Roman Empire
  2. Understand the concept of Peace in ancient times
  3. Apply lessons from history to modern business and tech
  4. Consider open-sourcing models like LLaMA
  5. Stay dynamic and adaptable in business and tech
💡 The importance of adapting to new ideas and open-sourcing models can be a key factor in success in business and tech, as seen in the examples of Caesar Augustus and Mark Zuckerberg.

Related Reads

📰
Mutation testing, but for LLM evals — early experiment, would love feedback
Learn to evaluate LLMs using mutation testing to improve model reliability and robustness
Dev.to · Ashwin Ugale
📰
Stop Calling Real LLMs in CI: Record the Decisions, Replay the Rest
Improve agent test suite efficiency by recording and replaying LLM decisions instead of calling real LLMs in CI
Medium · DevOps
📰
Stop Calling Real LLMs in CI: Record the Decisions, Replay the Rest
Optimize agent test suites by recording and replaying LLM decisions instead of calling real LLMs in CI to reduce slowness, expense, and flakiness
Medium · LLM
📰
AI From Scratch #1: What AI Actually Is (And What It Isn't)
Learn the basics of AI and its misconceptions to build a strong foundation for further learning
Dev.to · Abuka-Victor
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →