Why Not Just: Raise AI Like Kids?

Robert Miles AI Safety · Beginner ·📄 Research Papers Explained ·8y ago

Key Takeaways

The video discusses why raising Artificial General Intelligences (AGIs) like human children is not a viable solution for teaching them human values and ethics, referencing the stamp collector thought experiment and the complexity of human value learning. It highlights the importance of AI Safety Research, particularly in the area of value learning, and notes that simply programming human values into an AGI is not a straightforward task.

Full Transcript

hi I sometimes hear people saying if you want to create an artificial general intelligence that's safe and has human values why not just raise it like a human child I might do a series of these why not just videos you know why not just use the Three Laws uh why not just turn it off but yeah why not raise an AGI like a child seems reasonable enough at first glance right humans are General intelligences and we seem to know how to raise them to behave morally a young AGI would be a lot like a young human remember a long while back on computer file I was talking about this thought experiment of a stamp collecting a I use that because it's a good way of getting away from anthropomorphizing the system you're not just imagining a human mind the system has these clearly laid out Rules by which it operates it has an internet connection and a detailed internal model it can use to make predictions about the world it evaluates every possible sequence of packets it can send through its internet connection and it selects the one which it thinks will result in the most stamps collected after a year what happens if you try to raise the stamp collector like a human child is it going to learn human ethics from your good example no it's going to kill everyone values are not learned by osmosis the stamp collector doesn't have any part of its code that involves learning and adopting the values of humans around it so it doesn't do that now some of you may be saying how do you know agis won't be like humans um what if we make them by copying the human brain and it's true there is one kind of AGI like thing that's enough like a human that raising it like a human might kind of work a whole brain emulation but I'd be very surprised if the first agis are exact replicas of brains the first planes were not like birds the first submarines were not like fish making an exact replica of a bird or a fish requires way more understanding than just making a thing that flies or a thing that swims and I'd expect making an exact replica a brain to require a lot more understanding than just making something that thinks by the time we understand the operation of the brain well enough to make working whole brain emulations I expect we'll already know enough to make things that are less human but that function as agis so I don't know what the first agis will be like and they'll probably be more humanlike than the stamp collector but unless they're close copies of human brains they won't be similar enough to humans for raising them like children to automatically work blindly copying the brain probably isn't going to help us we're going to have to really understand how humans learn their values without a good system for that you may as well try raising a crocodile like it's a human child human value learning is a specific complex mechanism that evolved in humans and won't be in agis by default we look at the way children learn things so quickly we say they're like information sponges right they're just empty so they suck up whatever's around them but they don't suck up everything they only learn specific kinds of things raise a child around people speaking English it will learn English in another environment it might learn French but it's not going to reproduce the sound of the vacuum cleaner it's not going to learn the binary language of moisture vaporators or whatever the brain isn't learning and copying everything it's specifically looking for something that looks like a human natural language because there's this big complex existing structure put in place by Evolution and the brain is just looking for the final pieces I think values are similar you can think of the brains of young humans as having a little slot in them just waiting to accept a set of human social norms and rules of ethical Behavior there's this whole giant complicated machine of emotions and empathy and theory of other minds and so on built up over millions of years of evolution and the young brain is just waiting to fill in the few remaining blanks based on what the child observes when they're growing up when you raise a child you're not writing the child's source code at best you're writing the configuration file a child's upbringing is like a control panel on a machine you can press some of the buttons and turn some of the the dials but the Machinery has already been built by Evolution you're just changing some of the settings so if you try to raise an unsafe AGI as though it were a human child you can provide all the right inputs which in a human would produce a good moral adult but it won't work because you're pressing buttons and turning dials on a control panel that isn't hooked up to anything unless your AGI has all of this complicated stuff that's designed to learn and adopt values from the humans around it it isn't going to do that okay but can't we just program that in yeah hopefully we can but there's no just about it this is called value learning and it's an important part of AI Safety Research it may be that an AGI will need to have a period early on where it's learning about human values by interacting with humans and that might look a bit like raising a child if you squint but making a system that's able to undergo that learning process successfully and safely is hard it's something we don't know how to do yet and figuring it out is a big part of AI Safety Research so just raise the AGI like a child is not a solution it's at best a possible rephrasing of the [Music] problem I want to say a quick thank you to all of my amazing patreon supporters all of these these people and in this video I especially want to thank Sara cheda who also happens to be one of the people I'm sending the diagram that I drew in the previous video I'm going to send that out today or tomorrow I think that's kind of a fun thing to do so yeah from now on any video that has drawn Graphics in it uh just let me know in the patreon comments if you want me to send it to you and I can do that thanks again for your support and I'll see you next time

Original Description

Newly made Artificial General Intelligences are basically like children, right? So we already know we can teach them how to behave, right? Wrong. References to this Computerphile video: https://www.youtube.com/watch?v=tcdVC4e6EV4 and this paper: https://intelligence.org/files/ValueLearningProblem.pdf Thanks to my amazing Patreon Supporters: Sara Tjäder Jason Strack Chad Jones Ichiro Dohi Stefan Skiles Katie Byrne Ziyang Liu Jordan Medina James McCuen Joshua Richardson Fabian Consiglio Jonatan R Øystein Flygt Björn Mosten Michael Greve robertvanduursen The Guru Of Vision Fabrizio Pisani Alexander Hartvig Nielsen Volodymyr Peggy Youell Konstantin Shabashov Almighty Dodd DGJono Matthias Meger Scott Stevens Emilio Alvarez Benjamin Aaron Degenhart Michael Ore Robert Bridges Dmitri Afanasjev Brian Sandberg Einar Ueland Lo Rez C3POehne https://www.patreon.com/robertskmiles
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Robert Miles AI Safety · Robert Miles AI Safety · 7 of 47

1 Predicting AI: RIP Prof. Hubert Dreyfus
Predicting AI: RIP Prof. Hubert Dreyfus
Robert Miles AI Safety
2 Respectability
Respectability
Robert Miles AI Safety
3 Are AI Risks like Nuclear Risks?
Are AI Risks like Nuclear Risks?
Robert Miles AI Safety
4 Avoiding Negative Side Effects: Concrete Problems in AI Safety part 1
Avoiding Negative Side Effects: Concrete Problems in AI Safety part 1
Robert Miles AI Safety
5 Avoiding Positive Side Effects: Concrete Problems in AI Safety part 1.5
Avoiding Positive Side Effects: Concrete Problems in AI Safety part 1.5
Robert Miles AI Safety
6 Empowerment: Concrete Problems in AI Safety part 2
Empowerment: Concrete Problems in AI Safety part 2
Robert Miles AI Safety
Why Not Just: Raise AI Like Kids?
Why Not Just: Raise AI Like Kids?
Robert Miles AI Safety
8 Reward Hacking: Concrete Problems in AI Safety Part 3
Reward Hacking: Concrete Problems in AI Safety Part 3
Robert Miles AI Safety
9 The other "Killer Robot Arms Race" Elon Musk should worry about
The other "Killer Robot Arms Race" Elon Musk should worry about
Robert Miles AI Safety
10 Reward Hacking Reloaded: Concrete Problems in AI Safety Part 3.5
Reward Hacking Reloaded: Concrete Problems in AI Safety Part 3.5
Robert Miles AI Safety
11 What Can We Do About Reward Hacking?: Concrete Problems in AI Safety Part 4
What Can We Do About Reward Hacking?: Concrete Problems in AI Safety Part 4
Robert Miles AI Safety
12 What can AGI do? I/O and Speed
What can AGI do? I/O and Speed
Robert Miles AI Safety
13 AI learns to Create  ̵K̵Z̵F̵ ̵V̵i̵d̵e̵o̵s̵ Cat Pictures: Papers in Two Minutes #1
AI learns to Create ̵K̵Z̵F̵ ̵V̵i̵d̵e̵o̵s̵ Cat Pictures: Papers in Two Minutes #1
Robert Miles AI Safety
14 AI Safety at EAGlobal2017 Conference
AI Safety at EAGlobal2017 Conference
Robert Miles AI Safety
15 Scalable Supervision: Concrete Problems in AI Safety Part 5
Scalable Supervision: Concrete Problems in AI Safety Part 5
Robert Miles AI Safety
16 Superintelligence Mod for Civilization V
Superintelligence Mod for Civilization V
Robert Miles AI Safety
17 Why Would AI Want to do Bad Things? Instrumental Convergence
Why Would AI Want to do Bad Things? Instrumental Convergence
Robert Miles AI Safety
18 Experts' Predictions about the Future of AI
Experts' Predictions about the Future of AI
Robert Miles AI Safety
19 AI Safety Gridworlds
AI Safety Gridworlds
Robert Miles AI Safety
20 Friend or Foe? AI Safety Gridworlds extra bit
Friend or Foe? AI Safety Gridworlds extra bit
Robert Miles AI Safety
21 Safe Exploration: Concrete Problems in AI Safety Part 6
Safe Exploration: Concrete Problems in AI Safety Part 6
Robert Miles AI Safety
22 Why Not Just: Think of AGI Like a Corporation?
Why Not Just: Think of AGI Like a Corporation?
Robert Miles AI Safety
23 How to Keep Improving When You're Better Than Any Teacher - Iterated Distillation and Amplification
How to Keep Improving When You're Better Than Any Teacher - Iterated Distillation and Amplification
Robert Miles AI Safety
24 Is AI Safety a Pascal's Mugging?
Is AI Safety a Pascal's Mugging?
Robert Miles AI Safety
25 AI That Doesn't Try Too Hard - Maximizers and Satisficers
AI That Doesn't Try Too Hard - Maximizers and Satisficers
Robert Miles AI Safety
26 Training AI Without Writing A Reward Function, with Reward Modelling
Training AI Without Writing A Reward Function, with Reward Modelling
Robert Miles AI Safety
27 9 Examples of Specification Gaming
9 Examples of Specification Gaming
Robert Miles AI Safety
28 10 Reasons to Ignore AI Safety
10 Reasons to Ignore AI Safety
Robert Miles AI Safety
29 Sharing the Benefits of AI: The Windfall Clause
Sharing the Benefits of AI: The Windfall Clause
Robert Miles AI Safety
30 Quantilizers: AI That Doesn't Try Too Hard
Quantilizers: AI That Doesn't Try Too Hard
Robert Miles AI Safety
31 The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment
The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment
Robert Miles AI Safety
32 Deceptive Misaligned Mesa-Optimisers? It's More Likely Than You Think...
Deceptive Misaligned Mesa-Optimisers? It's More Likely Than You Think...
Robert Miles AI Safety
33 Intro to AI Safety, Remastered
Intro to AI Safety, Remastered
Robert Miles AI Safety
34 We Were Right! Real Inner Misalignment
We Were Right! Real Inner Misalignment
Robert Miles AI Safety
35 Apply to AI Safety Camp! #shorts
Apply to AI Safety Camp! #shorts
Robert Miles AI Safety
36 Win $50k for Solving a Single AI Problem? #Shorts
Win $50k for Solving a Single AI Problem? #Shorts
Robert Miles AI Safety
37 Free ML Bootcamp for Alignment #shorts
Free ML Bootcamp for Alignment #shorts
Robert Miles AI Safety
38 Apply Now for a Paid Residency on Interpretability #short
Apply Now for a Paid Residency on Interpretability #short
Robert Miles AI Safety
39 Why Does AI Lie, and What Can We Do About It?
Why Does AI Lie, and What Can We Do About It?
Robert Miles AI Safety
40 Apply to Study AI Safety Now! #shorts
Apply to Study AI Safety Now! #shorts
Robert Miles AI Safety
41 AI Ruined My Year
AI Ruined My Year
Robert Miles AI Safety
42 Learn AI Safety at MATS #shorts
Learn AI Safety at MATS #shorts
Robert Miles AI Safety
43 Using Dangerous AI, But Safely?
Using Dangerous AI, But Safely?
Robert Miles AI Safety
44 AI Safety Career Advice! (And So Can You!)
AI Safety Career Advice! (And So Can You!)
Robert Miles AI Safety
45 Robot Dog! Unitree Go2 review #shorts #robot #dog
Robot Dog! Unitree Go2 review #shorts #robot #dog
Robert Miles AI Safety
46 Tech is Good, AI Will Be Different
Tech is Good, AI Will Be Different
Robert Miles AI Safety
47 Apply for the Affine Superintelligence Alignment Seminar #shorts
Apply for the Affine Superintelligence Alignment Seminar #shorts
Robert Miles AI Safety

The video explains why raising AGIs like human children is not a solution for teaching them human values and ethics, and highlights the importance of AI Safety Research in the area of value learning. It discusses the complexity of human value learning and the challenges of programming human values into an AGI.

Key Takeaways
  1. Understand the stamp collector thought experiment and its implications for AGI development
  2. Recognize the complexity of human value learning and its importance for AI Safety
  3. Evaluate the potential risks associated with AGI development and the need for AI Safety Research
  4. Develop strategies for mitigating these risks and ensuring the safe development of AGIs
💡 Human value learning is a specific, complex mechanism that evolved in humans and won't be present in AGIs by default, making it essential to develop AI Safety strategies that address this challenge.

Related Reads

📰
I Spent Weeks Looking for a Research Gap Before I Realized I Was Searching the Wrong Way
Learn how to effectively find research gaps by changing your approach, a crucial skill for AI researchers and academics
Medium · AI
📰
ICMI 2026 Reviews [D]
Learn how to interpret ICMI 2026 reviews and improve your paper's acceptance chances
Reddit r/MachineLearning
📰
Workshop submission for main conference paper under review [D]
Learn how to navigate submitting a paper to a non-archival workshop before the final decision of a main conference like ECCV
Reddit r/MachineLearning
📰
Kept context-switching between arxiv, OpenReview, GitHub, and HuggingFace for every paper, so I built this. Chrome extension + website with everything inline, plus citation graph + SPECTER2 neighbors. 3M papers, free, feedback welcome [P]
Streamline your research with a new Chrome extension and website that integrates 3M papers from arxiv, OpenReview, GitHub, and HuggingFace, including citation graphs and SPECTER2 neighbors, and provide feedback to improve it
Reddit r/MachineLearning
Up next
Indians Under House Arrest in America? 😱 Immigration Crisis Explained | SumanTV Classroom
SumanTV Classroom
Watch →