This Model Caused A Nuclear Disaster

Underfitted · Beginner ·🧬 Deep Learning ·3y ago

Key Takeaways

The video discusses the 2011 Fukushima nuclear disaster and how a predictive model failed to account for the possibility of a massive earthquake and tsunami occurring simultaneously, highlighting the importance of proper probability assessment and avoiding overfitting in machine learning models, specifically the Gutenberg-Richter law and the dangers of assuming independence between events.

Full Transcript

foreign a massive earthquake hit Japan up to this point it Remains the most powerful earthquake ever recorded in the country but that was just the beginning the earthquake triggered a tsunami with waves as high as 130 feet that's the height of a 12-story building and it all started going down from there here is a map of Japan and that right there is the fukuchima power plant now I found this picture from 2007 where you get a pretty good view of the plant well the waves caused by the tsunami hit the nuclear plant and damaged the emergency generators right when they most needed them they lost electric power leading to the most severe nuclear accident since Chernobyl in 1986 around 154 000 people had to be evacuated it was brutal now I'm not a historian but I wanted to show you this because this disaster could have been prevented Behind These devastating nuclear accident there was a model that failed so I started the research for this video with one specific idea in mind but while looking through some of the information that came after the accident I found something that I wanted to share with you this report right here has hundreds of pages and I did not print them all but I found buried inside what could have been one of the first mistakes the engineers made when designing the nuclear plant let's talk about probabilities the structural engineers who built the Fukushima plan knew they had to be ready for earthquakes and tsunamis it's Japan right the question was not whether a disaster would happen they knew there would be plenty of them the question was how bad it could actually get let's run through some ideas here let's say the probability of an earthquake and of a tsunami is 10 to the negative four I got these numbers from the report the question we need to answer is what would happen under the pressure of of the combined force of these two natural disasters more specifically do we even need to worry about this happening simultaneously that's what this formula can help us answer this equation represents the probability of our worst case scenario a tsunami and an earthquake occurring at the same time fortunately we know what this term means is 10 to the negative 4 but we don't know what this is this term is the conditional probability of a tsunami given that an earthquake occurs we need to find it to determine whether we need to worry about our worst case scenario there are two possibilities here if these two events are independent we can say that the probability of a tsunami given an earthquake is the same as the probability of a tsunami this means that an earthquake will not make a tsunami any more likely let's see what happens now if an earthquake and a tsunami are independent events this is how we will compute the probability of our worst case scenario we know these values the probability of an earthquake and the probability of a tsunami they are 10 to the negative four so if we substitute those into this equation we will get the final probability and look at that result 10 to the negative 8. this is so small that it will be almost impossible for an earthquake and a tsunami to occur as they did the report claims that this could have been one of the mistakes and the holy state was assuming that earthquakes and tsunamis are independent events it's actually very likely to see a tsunami after we see an earthquake of that magnitude shock waves that gave birth to a massive tsunami that started 35 minutes later assuming the conditional probability is one here's how we will compute the probability of our worst case scenario look at the result is substantially higher than 10 to the negative 8. that's one of the conclusions that's one of the conclusions of this report right here people responsible for the plant safety might have considered earthquakes and tsunamis as independent events so they didn't think the worst case scenario was actually possible unfortunately that was not the only mistake they made [Music] the Fukushima nuclear reactor was ready to withstand a magnitude 8.6 earthquake that's not bad except the earthquake of 2011 was a massive 9.1 but again we're talking about Japan here they get plenty of earthquakes so why were they underprepared for starters they had not seen an earthquake that big before okay so it sort of makes sense they were not necessarily expecting something like that to happen but come on we were scientists we cannot just assume something we haven't seen will never happen right we have to go deeper than that so let me show you this book here the signal and the noise why so many predictions fail but some don't written by Nate silver you've gotta check this book out Nate looked at the data and what he found was fascinating here it is let's start with the plot of the historical frequency of earthquakes around Japan the x-axis shows the magnitude and the y-axis chose the annual frequency of these earthquakes right off the bat it makes sense that smaller earthquakes happen very frequently while big ones rarely happen two interesting things in this plot here first notice how the data does not show any earthquakes larger than eight remember up to that point there was no indication of such a large earthquake ever happening there and second there is a kink here in the shark notice how it doesn't follow the same pattern the curve bends a little this is not surprising first there is not a lot of data about large earthquakes because they're less frequent and second there had been no earthquakes as large as a magnitude Aid in the region since 1964. all right decent data was available to the team who had to make a crucial decision how to prepare how to fortify the nuclear reactor to do that they needed to predict the frequency of these large earthquakes fortunately we've got the gardenberg rooster law which expresses the relationship between the magnitude and the frequency of earthquakes are in a very convoluted way this page explains that we should expect a straight line pattern in a region like Japan this is a straight line notice how this model ignores the kink in the data if you use this model the straight line to compute the frequency of an earthquake of magnitude 9 in that region you should expect that they will happen every 300 years or so it's a long time but it's not crazy so why didn't they use this information well maybe this has something to do with it this is what overfitting looks like this line here is called a characteristic fit and it follows the historical data notice how this model bends with the Kink right here the model assumes that there is a good reason for the Kink so it's not just an accident or lack of data so the model follows it not a big deal right well this model predicts an earthquake of magnitude 9 every 13 000 years if you ask me that is pretty much impossible compare that with the 300 years predicted by the first model the team in charge of all of these ignore the Gothenburg register law and instead overfit their predictive model to the data a hat now the law did not predict that an earthquake of that magnitude was going to happen that year of course not but it hinted at the possibility of an event like that happening within a reasonable time span two big mistakes dire consequences there is a lesson somewhere in there [Music]

Original Description

In 2011, a massive earthquake followed by a tsunami hit Japan. This led to the most severe nuclear accident since Chernobyl in 1986. What many people don't know is that behind this devastating nuclear accident, there was a predictive model that failed. Citations: https://gist.github.com/svpino/90cf304539d536cced03d1455bdb47b0 🔔 Subscribe for more stories: https://www.youtube.com/@underfitted?sub_confirmation=1 📚 My 3 favorite Machine Learning books: • Deep Learning With Python, Second Edition — https://amzn.to/3xA3bVI • Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow — https://amzn.to/3BOX3LP • Machine Learning with PyTorch and Scikit-Learn — https://amzn.to/3f7dAC8 Twitter: https://twitter.com/svpino Disclaimer: Some of the links included in this description are affiliate links where I'll earn a small commission if you purchase something. There's no cost to you.
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Underfitted · Underfitted · 22 of 60

1 Test-Time Augmentation In Machine Learning.
Test-Time Augmentation In Machine Learning.
Underfitted
2 Don't Replace Missing Values In Your Dataset.
Don't Replace Missing Values In Your Dataset.
Underfitted
3 Introduction to Adversarial Validation In Machine Learning.
Introduction to Adversarial Validation In Machine Learning.
Underfitted
4 Introduction To Autoencoders In Machine Learning.
Introduction To Autoencoders In Machine Learning.
Underfitted
5 Active Learning. The Secret of Training Models Without Labels.
Active Learning. The Secret of Training Models Without Labels.
Underfitted
6 Early Stopping. The Most Popular Regularization Technique In Machine Learning.
Early Stopping. The Most Popular Regularization Technique In Machine Learning.
Underfitted
7 The Confusion Matrix in Machine Learning
The Confusion Matrix in Machine Learning
Underfitted
8 3 Tips to Build a Career in Machine Learning (Unconventional Advice)
3 Tips to Build a Career in Machine Learning (Unconventional Advice)
Underfitted
9 I can predict cars CRASHING. And it's 99% accurate!
I can predict cars CRASHING. And it's 99% accurate!
Underfitted
10 A Critical Skill People Learn Too LATE: Learning Curves In Machine Learning.
A Critical Skill People Learn Too LATE: Learning Curves In Machine Learning.
Underfitted
11 The BEST Machine Learning Interview Strategy.
The BEST Machine Learning Interview Strategy.
Underfitted
12 OpenAI’s Whisper is AMAZING!
OpenAI’s Whisper is AMAZING!
Underfitted
13 5 Lessons You’re NOT Taught in School
5 Lessons You’re NOT Taught in School
Underfitted
14 TensorFlow On Apple Silicon. Step-by-Step Instructions
TensorFlow On Apple Silicon. Step-by-Step Instructions
Underfitted
15 Generating Images From Text. Stable Diffusion, Explained
Generating Images From Text. Stable Diffusion, Explained
Underfitted
16 The Wrong Batch Size Will Ruin Your Model
The Wrong Batch Size Will Ruin Your Model
Underfitted
17 8 Mistakes Holding Your Career Back | Machine Learning
8 Mistakes Holding Your Career Back | Machine Learning
Underfitted
18 AI Just Solved a 53-Year-Old Problem! | AlphaTensor, Explained
AI Just Solved a 53-Year-Old Problem! | AlphaTensor, Explained
Underfitted
19 Bias and Variance, Simplified
Bias and Variance, Simplified
Underfitted
20 Should You Stop Splitting Your Data Like This?
Should You Stop Splitting Your Data Like This?
Underfitted
21 The Function That Changed Everything
The Function That Changed Everything
Underfitted
This Model Caused A Nuclear Disaster
This Model Caused A Nuclear Disaster
Underfitted
23 Will Your Code Write Itself?
Will Your Code Write Itself?
Underfitted
24 The Simplest Encoding You’ve Never Heard Of
The Simplest Encoding You’ve Never Heard Of
Underfitted
25 Superhuman AI Cracked An Impossible Game! | DeepNash, Explained
Superhuman AI Cracked An Impossible Game! | DeepNash, Explained
Underfitted
26 Can you become a Data Scientist without a Ph.D?
Can you become a Data Scientist without a Ph.D?
Underfitted
27 How to 10x your productivity with ChatGPT?
How to 10x your productivity with ChatGPT?
Underfitted
28 Cheating the Prisoner's Dilemma
Cheating the Prisoner's Dilemma
Underfitted
29 We integrated OpenAI's Whisper with Spot
We integrated OpenAI's Whisper with Spot
Underfitted
30 The Machine Learning School program
The Machine Learning School program
Underfitted
31 We integrated ChatGPT with our robots
We integrated ChatGPT with our robots
Underfitted
32 Solving complex tasks using a Large Language Model (LLM)
Solving complex tasks using a Large Language Model (LLM)
Underfitted
33 5 problems when using a Large Language Model
5 problems when using a Large Language Model
Underfitted
34 We just discovered faster sorting algorithms!
We just discovered faster sorting algorithms!
Underfitted
35 The 3 most important updates to OpenAI's API.
The 3 most important updates to OpenAI's API.
Underfitted
36 People are divided! Does GPT-4 understand what it says?
People are divided! Does GPT-4 understand what it says?
Underfitted
37 How much should you charge hourly as a Machine Learning freelancer?
How much should you charge hourly as a Machine Learning freelancer?
Underfitted
38 Building a RAG application from scratch using Python, LangChain, and the OpenAI API
Building a RAG application from scratch using Python, LangChain, and the OpenAI API
Underfitted
39 Building a RAG application using open-source models (Asking questions from a PDF using Llama2)
Building a RAG application using open-source models (Asking questions from a PDF using Llama2)
Underfitted
40 How to evaluate an LLM-powered RAG application automatically.
How to evaluate an LLM-powered RAG application automatically.
Underfitted
41 Step by step no-code RAG application using Langflow.
Step by step no-code RAG application using Langflow.
Underfitted
42 I built a simple game using Langchain. Here is a step by step tutorial.
I built a simple game using Langchain. Here is a step by step tutorial.
Underfitted
43 I used the first AI Software Engineer for a week. This is happening.
I used the first AI Software Engineer for a week. This is happening.
Underfitted
44 I deployed a recommendation model. Testing Models In Production using Interleaving Experiments.
I deployed a recommendation model. Testing Models In Production using Interleaving Experiments.
Underfitted
45 How to run PyTorch, TensorFlow, and JAX on your Mac (Apple Silicon)
How to run PyTorch, TensorFlow, and JAX on your Mac (Apple Silicon)
Underfitted
46 How to train a model to generate image embeddings from scratch
How to train a model to generate image embeddings from scratch
Underfitted
47 Building an AI assistant that listens and sees the world (Step by step tutorial)
Building an AI assistant that listens and sees the world (Step by step tutorial)
Underfitted
48 Why are vector databases so FAST?
Why are vector databases so FAST?
Underfitted
49 A Machine Learning roadmap (the one I recommend to my students)
A Machine Learning roadmap (the one I recommend to my students)
Underfitted
50 How to build a real-time AI assistant (with voice and vision)
How to build a real-time AI assistant (with voice and vision)
Underfitted
51 An introduction to Mojo (for Python developers)
An introduction to Mojo (for Python developers)
Underfitted
52 How does Lexical Scoping in Mojo 🔥 works (under 3 minutes)
How does Lexical Scoping in Mojo 🔥 works (under 3 minutes)
Underfitted
53 Building a CI workflow for those who hate it (using GitHub Actions)
Building a CI workflow for those who hate it (using GitHub Actions)
Underfitted
54 How to run Python Code in Mojo 🔥
How to run Python Code in Mojo 🔥
Underfitted
55 AI will not take your job. Here is what I think will happen instead.
AI will not take your job. Here is what I think will happen instead.
Underfitted
56 How to fine-tune a model using LoRA (step by step)
How to fine-tune a model using LoRA (step by step)
Underfitted
57 Late initialization in Mojo🔥 (Python doesn't support this)
Late initialization in Mojo🔥 (Python doesn't support this)
Underfitted
58 The $1,000,000 problem AI can't solve
The $1,000,000 problem AI can't solve
Underfitted
59 A gentle introduction to RAG (using open-source models)
A gentle introduction to RAG (using open-source models)
Underfitted
60 Automating feedback using ChatGPT and Zapier
Automating feedback using ChatGPT and Zapier
Underfitted

The video teaches the importance of proper probability assessment and avoiding overfitting in machine learning models, using the example of the Fukushima nuclear disaster. It highlights the dangers of assuming independence between events and the importance of using established laws and principles, such as the Gutenberg-Richter law, to inform predictive models. By understanding these concepts, viewers can improve their skills in machine learning and risk assessment.

Key Takeaways
  1. Understand the concept of probability and its application to real-world problems
  2. Learn to identify and avoid overfitting in machine learning models
  3. Apply the Gutenberg-Richter law to predict the frequency of earthquakes
  4. Assess risk using predictive models and consider multiple scenarios
  5. Evaluate model performance using metrics and consider the limitations of historical data
💡 The assumption of independence between events can lead to catastrophic consequences, and using established laws and principles can inform predictive models and improve risk assessment.

Related Reads

📰
Understanding Deep Learning Through Four Interactive Experiments
Explore deep learning concepts through interactive experiments to gain hands-on understanding
Medium · Data Science
📰
Understanding Deep Learning Through Four Interactive Experiments
Explore deep learning through interactive experiments to gain hands-on understanding
Medium · Deep Learning
📰
Optimizers in Deep Learning: From Gradient Descent to Adam
Learn how optimizers in deep learning work, from basic Gradient Descent to advanced Adam optimizer, to improve model training
Medium · Deep Learning
📰
The Meta-Architecture of Interface Fracture: High-Dimensional Logical Stress and Systemic Collapse…
Learn about the meta-architecture of interface fracture and its relation to high-dimensional logical stress and systemic collapse in deep learning systems
Medium · Deep Learning
Up next
Image Classification with ml5.js
The Coding Train
Watch →