L2 Regularization neural network in Python from Scratch | Explanation with Implementation

Learn With Jay · Beginner ·📐 ML Fundamentals ·4y ago

About this lesson

This video is an overall package to understand L2 Regularization Neural Network and then implement it in Python from scratch. L2 Regularization neural network it a technique to overcome overfitting. When your training accuracy is very high, but test accuracy is very low, the model highly overfits the training dataset set and struggle to make good predictions on test dataset. Overfitting in Deep Learning can be the result of having a very deep neural network or high number of neurons. With L2 Regularization Neural Network, we nullifying the effect of certain neurons, and thus, we create a simple network that will generate decision boundary that fits well in both training as well as test dataset. If our model is not overfitting, then we need not use L2 Regularization. But when our model is overfitting, only then we use L2 Regularization. ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ 📕 Download the ASSIGNMENT and Implementation Code : https://github.com/Coding-Lane/L2-Regularization ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ ✔ Neural Network in Python from Scratch : https://www.youtube.com/watch?v=vtx1iwmOx10&t=284s&pp=sAQA ✔ Complete Neural Network playlist : https://www.youtube.com/watch?v=mlk0rddP3L4&list=PLuhqtP7jdD8CftMk831qdE8BlIteSaNzD ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ ✔ Overfitting and Underfitting :https://www.youtube.com/watch?v=SOI39DEHGSk&t=0s ✔ Complete Logistic Regression Playlist : https://www.youtube.com/watch?v=U1omz0B9FTw&list=PLuhqtP7jdD8Chy7QIo5U0zzKP8-emLdny ✔ Complete Linear Regression Playlist : https://www.youtube.com/watch?v=nwD5U2WxTdk&list=PLuhqtP7jdD8AFocJuxC6_Zz0HepAWL9cF ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ Timestamp: 0:00 Video Agenda 0:59 Overfitting in Deep Learning 1:47 Why Overfitting occurs 3:52 L2 Regularization 5:58 L1 Regularization 6:40 L2 Regularization in Neural Network 9:15 L2 Regularization in Python 14:58 Changing value of Lambda ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ This is Your Lane to Machine Learning ⭐ ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ Subscribe to my channel, because I upload a new Machine Learning video every week : https://www.y

Original Description

This video is an overall package to understand L2 Regularization Neural Network and then implement it in Python from scratch. L2 Regularization neural network it a technique to overcome overfitting. When your training accuracy is very high, but test accuracy is very low, the model highly overfits the training dataset set and struggle to make good predictions on test dataset. Overfitting in Deep Learning can be the result of having a very deep neural network or high number of neurons. With L2 Regularization Neural Network, we nullifying the effect of certain neurons, and thus, we create a simple network that will generate decision boundary that fits well in both training as well as test dataset. If our model is not overfitting, then we need not use L2 Regularization. But when our model is overfitting, only then we use L2 Regularization. ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ 📕 Download the ASSIGNMENT and Implementation Code : https://github.com/Coding-Lane/L2-Regularization ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ ✔ Neural Network in Python from Scratch : https://www.youtube.com/watch?v=vtx1iwmOx10&t=284s&pp=sAQA ✔ Complete Neural Network playlist : https://www.youtube.com/watch?v=mlk0rddP3L4&list=PLuhqtP7jdD8CftMk831qdE8BlIteSaNzD ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ ✔ Overfitting and Underfitting :https://www.youtube.com/watch?v=SOI39DEHGSk&t=0s ✔ Complete Logistic Regression Playlist : https://www.youtube.com/watch?v=U1omz0B9FTw&list=PLuhqtP7jdD8Chy7QIo5U0zzKP8-emLdny ✔ Complete Linear Regression Playlist : https://www.youtube.com/watch?v=nwD5U2WxTdk&list=PLuhqtP7jdD8AFocJuxC6_Zz0HepAWL9cF ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ Timestamp: 0:00 Video Agenda 0:59 Overfitting in Deep Learning 1:47 Why Overfitting occurs 3:52 L2 Regularization 5:58 L1 Regularization 6:40 L2 Regularization in Neural Network 9:15 L2 Regularization in Python 14:58 Changing value of Lambda ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ This is Your Lane to Machine Learning ⭐ ➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖ Subscribe to my channel, because I upload a new Machine Learning video every week : https://www.y
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

⚡
Stop Overfitting With Basically One Line of Code
Learn to prevent overfitting with a simple code tweak and understand the difference between Ridge and Lasso regression
Medium · AI
 ⚡
Stop Overfitting With Basically One Line of Code
Learn to prevent overfitting in machine learning models with a simple code tweak and understand the difference between Ridge and Lasso regression
Medium · Machine Learning
 ⚡
Stop Overfitting With Basically One Line of Code
Prevent overfitting in models with a simple code tweak, understanding the difference between Ridge and Lasso regression
Medium · Data Science
 ⚡
Stop Overfitting With Basically One Line of Code
Learn to prevent overfitting in machine learning models with a simple code tweak, comparing Ridge and Lasso regression techniques
Medium · Python

Chapters (8)

Video Agenda
0:59 Overfitting in Deep Learning
1:47 Why Overfitting occurs
3:52 L2 Regularization
5:58 L1 Regularization
6:40 L2 Regularization in Neural Network
9:15 L2 Regularization in Python
14:58 Changing value of Lambda
Up next
Learn Deep Learning by Hand (Beginner's Guide - Part 1)
Thu Vu
Watch →