This Model Caused A Nuclear Disaster
Key Takeaways
The video discusses the 2011 Fukushima nuclear disaster and how a predictive model failed to account for the possibility of a massive earthquake and tsunami occurring simultaneously, highlighting the importance of proper probability assessment and avoiding overfitting in machine learning models, specifically the Gutenberg-Richter law and the dangers of assuming independence between events.
Full Transcript
foreign a massive earthquake hit Japan up to this point it Remains the most powerful earthquake ever recorded in the country but that was just the beginning the earthquake triggered a tsunami with waves as high as 130 feet that's the height of a 12-story building and it all started going down from there here is a map of Japan and that right there is the fukuchima power plant now I found this picture from 2007 where you get a pretty good view of the plant well the waves caused by the tsunami hit the nuclear plant and damaged the emergency generators right when they most needed them they lost electric power leading to the most severe nuclear accident since Chernobyl in 1986 around 154 000 people had to be evacuated it was brutal now I'm not a historian but I wanted to show you this because this disaster could have been prevented Behind These devastating nuclear accident there was a model that failed so I started the research for this video with one specific idea in mind but while looking through some of the information that came after the accident I found something that I wanted to share with you this report right here has hundreds of pages and I did not print them all but I found buried inside what could have been one of the first mistakes the engineers made when designing the nuclear plant let's talk about probabilities the structural engineers who built the Fukushima plan knew they had to be ready for earthquakes and tsunamis it's Japan right the question was not whether a disaster would happen they knew there would be plenty of them the question was how bad it could actually get let's run through some ideas here let's say the probability of an earthquake and of a tsunami is 10 to the negative four I got these numbers from the report the question we need to answer is what would happen under the pressure of of the combined force of these two natural disasters more specifically do we even need to worry about this happening simultaneously that's what this formula can help us answer this equation represents the probability of our worst case scenario a tsunami and an earthquake occurring at the same time fortunately we know what this term means is 10 to the negative 4 but we don't know what this is this term is the conditional probability of a tsunami given that an earthquake occurs we need to find it to determine whether we need to worry about our worst case scenario there are two possibilities here if these two events are independent we can say that the probability of a tsunami given an earthquake is the same as the probability of a tsunami this means that an earthquake will not make a tsunami any more likely let's see what happens now if an earthquake and a tsunami are independent events this is how we will compute the probability of our worst case scenario we know these values the probability of an earthquake and the probability of a tsunami they are 10 to the negative four so if we substitute those into this equation we will get the final probability and look at that result 10 to the negative 8. this is so small that it will be almost impossible for an earthquake and a tsunami to occur as they did the report claims that this could have been one of the mistakes and the holy state was assuming that earthquakes and tsunamis are independent events it's actually very likely to see a tsunami after we see an earthquake of that magnitude shock waves that gave birth to a massive tsunami that started 35 minutes later assuming the conditional probability is one here's how we will compute the probability of our worst case scenario look at the result is substantially higher than 10 to the negative 8. that's one of the conclusions that's one of the conclusions of this report right here people responsible for the plant safety might have considered earthquakes and tsunamis as independent events so they didn't think the worst case scenario was actually possible unfortunately that was not the only mistake they made [Music] the Fukushima nuclear reactor was ready to withstand a magnitude 8.6 earthquake that's not bad except the earthquake of 2011 was a massive 9.1 but again we're talking about Japan here they get plenty of earthquakes so why were they underprepared for starters they had not seen an earthquake that big before okay so it sort of makes sense they were not necessarily expecting something like that to happen but come on we were scientists we cannot just assume something we haven't seen will never happen right we have to go deeper than that so let me show you this book here the signal and the noise why so many predictions fail but some don't written by Nate silver you've gotta check this book out Nate looked at the data and what he found was fascinating here it is let's start with the plot of the historical frequency of earthquakes around Japan the x-axis shows the magnitude and the y-axis chose the annual frequency of these earthquakes right off the bat it makes sense that smaller earthquakes happen very frequently while big ones rarely happen two interesting things in this plot here first notice how the data does not show any earthquakes larger than eight remember up to that point there was no indication of such a large earthquake ever happening there and second there is a kink here in the shark notice how it doesn't follow the same pattern the curve bends a little this is not surprising first there is not a lot of data about large earthquakes because they're less frequent and second there had been no earthquakes as large as a magnitude Aid in the region since 1964. all right decent data was available to the team who had to make a crucial decision how to prepare how to fortify the nuclear reactor to do that they needed to predict the frequency of these large earthquakes fortunately we've got the gardenberg rooster law which expresses the relationship between the magnitude and the frequency of earthquakes are in a very convoluted way this page explains that we should expect a straight line pattern in a region like Japan this is a straight line notice how this model ignores the kink in the data if you use this model the straight line to compute the frequency of an earthquake of magnitude 9 in that region you should expect that they will happen every 300 years or so it's a long time but it's not crazy so why didn't they use this information well maybe this has something to do with it this is what overfitting looks like this line here is called a characteristic fit and it follows the historical data notice how this model bends with the Kink right here the model assumes that there is a good reason for the Kink so it's not just an accident or lack of data so the model follows it not a big deal right well this model predicts an earthquake of magnitude 9 every 13 000 years if you ask me that is pretty much impossible compare that with the 300 years predicted by the first model the team in charge of all of these ignore the Gothenburg register law and instead overfit their predictive model to the data a hat now the law did not predict that an earthquake of that magnitude was going to happen that year of course not but it hinted at the possibility of an event like that happening within a reasonable time span two big mistakes dire consequences there is a lesson somewhere in there [Music]
Original Description
In 2011, a massive earthquake followed by a tsunami hit Japan.
This led to the most severe nuclear accident since Chernobyl in 1986.
What many people don't know is that behind this devastating nuclear accident, there was a predictive model that failed.
Citations: https://gist.github.com/svpino/90cf304539d536cced03d1455bdb47b0
🔔 Subscribe for more stories: https://www.youtube.com/@underfitted?sub_confirmation=1
📚 My 3 favorite Machine Learning books:
• Deep Learning With Python, Second Edition — https://amzn.to/3xA3bVI
• Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow — https://amzn.to/3BOX3LP
• Machine Learning with PyTorch and Scikit-Learn — https://amzn.to/3f7dAC8
Twitter: https://twitter.com/svpino
Disclaimer: Some of the links included in this description are affiliate links where I'll earn a small commission if you purchase something. There's no cost to you.
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Underfitted · Underfitted · 22 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
▶
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Test-Time Augmentation In Machine Learning.
Underfitted
Don't Replace Missing Values In Your Dataset.
Underfitted
Introduction to Adversarial Validation In Machine Learning.
Underfitted
Introduction To Autoencoders In Machine Learning.
Underfitted
Active Learning. The Secret of Training Models Without Labels.
Underfitted
Early Stopping. The Most Popular Regularization Technique In Machine Learning.
Underfitted
The Confusion Matrix in Machine Learning
Underfitted
3 Tips to Build a Career in Machine Learning (Unconventional Advice)
Underfitted
I can predict cars CRASHING. And it's 99% accurate!
Underfitted
A Critical Skill People Learn Too LATE: Learning Curves In Machine Learning.
Underfitted
The BEST Machine Learning Interview Strategy.
Underfitted
OpenAI’s Whisper is AMAZING!
Underfitted
5 Lessons You’re NOT Taught in School
Underfitted
TensorFlow On Apple Silicon. Step-by-Step Instructions
Underfitted
Generating Images From Text. Stable Diffusion, Explained
Underfitted
The Wrong Batch Size Will Ruin Your Model
Underfitted
8 Mistakes Holding Your Career Back | Machine Learning
Underfitted
AI Just Solved a 53-Year-Old Problem! | AlphaTensor, Explained
Underfitted
Bias and Variance, Simplified
Underfitted
Should You Stop Splitting Your Data Like This?
Underfitted
The Function That Changed Everything
Underfitted
This Model Caused A Nuclear Disaster
Underfitted
Will Your Code Write Itself?
Underfitted
The Simplest Encoding You’ve Never Heard Of
Underfitted
Superhuman AI Cracked An Impossible Game! | DeepNash, Explained
Underfitted
Can you become a Data Scientist without a Ph.D?
Underfitted
How to 10x your productivity with ChatGPT?
Underfitted
Cheating the Prisoner's Dilemma
Underfitted
We integrated OpenAI's Whisper with Spot
Underfitted
The Machine Learning School program
Underfitted
We integrated ChatGPT with our robots
Underfitted
Solving complex tasks using a Large Language Model (LLM)
Underfitted
5 problems when using a Large Language Model
Underfitted
We just discovered faster sorting algorithms!
Underfitted
The 3 most important updates to OpenAI's API.
Underfitted
People are divided! Does GPT-4 understand what it says?
Underfitted
How much should you charge hourly as a Machine Learning freelancer?
Underfitted
Building a RAG application from scratch using Python, LangChain, and the OpenAI API
Underfitted
Building a RAG application using open-source models (Asking questions from a PDF using Llama2)
Underfitted
How to evaluate an LLM-powered RAG application automatically.
Underfitted
Step by step no-code RAG application using Langflow.
Underfitted
I built a simple game using Langchain. Here is a step by step tutorial.
Underfitted
I used the first AI Software Engineer for a week. This is happening.
Underfitted
I deployed a recommendation model. Testing Models In Production using Interleaving Experiments.
Underfitted
How to run PyTorch, TensorFlow, and JAX on your Mac (Apple Silicon)
Underfitted
How to train a model to generate image embeddings from scratch
Underfitted
Building an AI assistant that listens and sees the world (Step by step tutorial)
Underfitted
Why are vector databases so FAST?
Underfitted
A Machine Learning roadmap (the one I recommend to my students)
Underfitted
How to build a real-time AI assistant (with voice and vision)
Underfitted
An introduction to Mojo (for Python developers)
Underfitted
How does Lexical Scoping in Mojo 🔥 works (under 3 minutes)
Underfitted
Building a CI workflow for those who hate it (using GitHub Actions)
Underfitted
How to run Python Code in Mojo 🔥
Underfitted
AI will not take your job. Here is what I think will happen instead.
Underfitted
How to fine-tune a model using LoRA (step by step)
Underfitted
Late initialization in Mojo🔥 (Python doesn't support this)
Underfitted
The $1,000,000 problem AI can't solve
Underfitted
A gentle introduction to RAG (using open-source models)
Underfitted
Automating feedback using ChatGPT and Zapier
Underfitted
More on: ML Maths Basics
View skill →Related Reads
📰
📰
📰
📰
Understanding Deep Learning Through Four Interactive Experiments
Medium · Data Science
Understanding Deep Learning Through Four Interactive Experiments
Medium · Deep Learning
Optimizers in Deep Learning: From Gradient Descent to Adam
Medium · Deep Learning
The Meta-Architecture of Interface Fracture: High-Dimensional Logical Stress and Systemic Collapse…
Medium · Deep Learning
🎓
Tutor Explanation
DeepCamp AI