LSTM Networks: Explained Step by Step!

ritvikmath · Beginner ·📐 ML Fundamentals ·3y ago
Why we need LSTM networks, how they work step by step, and full explanations: visual and mathematical! 0:00 Problem with Simple RNNs 11:45 Goal of LSTM 12:55 Introducing the Cell State 14:27 Step 1: The Candidate Cell State 15:52 Step 2: The Forget Gate 17:48 Step 3: The Input Gate 18:18 Step 4: The New Cell State 21:15 Step 5: The Output Gate 22:31 Step 6: The New Output State 22:57 Visual Diagram 27:14 Recap all Variables 29:49 Why does this work? My Patreon : https://www.patreon.com/user?u=49277905 --- RNN Video : https://www.youtube.com/watch?v=DFZ1UA7-fxY Vanishing Gradient Video : https://www.youtube.com/watch?v=ncTHBi8a9uA Intro to Neural Networks : https://www.youtube.com/watch?v=xx1hS1EQLNw Backpropagation : https://www.youtube.com/watch?v=kbGu60QBx2o --- Icon References: Dog icons created by Freepik - Flaticon https://www.flaticon.com/free-icons/dog Gate icons created by Freepik - Flaticon https://www.flaticon.com/free-icons/gate Memory icons created by Freepik - Flaticon https://www.flaticon.com/free-icons/memory Crystal ball icons created by Freepik - Flaticon https://www.flaticon.com/free-icons/crystal-ball Khao manee cat icons created by Pixel perfect - Flaticon https://www.flaticon.com/free-icons/khao-manee-cat
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from ritvikmath · ritvikmath · 0 of 60

← Previous Next →
1 Math Team Update
Math Team Update
ritvikmath
 2 Single Variable Calculus Volume of a Sphere - Proof 1
Single Variable Calculus Volume of a Sphere - Proof 1
ritvikmath
 3 Single Variable Calculus Volume of a Sphere - Proof 2
Single Variable Calculus Volume of a Sphere - Proof 2
ritvikmath
 4 Multivariable Calculus Volume of a Sphere Proof - Triple Integrals
Multivariable Calculus Volume of a Sphere Proof - Triple Integrals
ritvikmath
 5 Multivariable Calculus Volume of a Sphere Proof - Double Integrals
Multivariable Calculus Volume of a Sphere Proof - Double Integrals
ritvikmath
 6 The Euclidian Algorithm
The Euclidian Algorithm
ritvikmath
 7 Proving the Chain Rule
Proving the Chain Rule
ritvikmath
 8 Proving the Fundamental Theorem of Calculus Part 1
Proving the Fundamental Theorem of Calculus Part 1
ritvikmath
 9 Proving the Fundamental Theorem of Calculus Part 2
Proving the Fundamental Theorem of Calculus Part 2
ritvikmath
 10 Math Puzzle - Poison Perplexity
Math Puzzle - Poison Perplexity
ritvikmath
 11 Math Puzzle - Poison Perplexity - Solution
Math Puzzle - Poison Perplexity - Solution
ritvikmath
 12 Expected Value and Variance of Continuous Random Variables (Calculus)
Expected Value and Variance of Continuous Random Variables (Calculus)
ritvikmath
 13 Expected Value and Variance of Discrete Random Variables (No Calculus)
Expected Value and Variance of Discrete Random Variables (No Calculus)
ritvikmath
 14 Array Method
Array Method
ritvikmath
 15 Complex Power Series and their Derivatives
Complex Power Series and their Derivatives
ritvikmath
 16 Distributions - Intro
Distributions - Intro
ritvikmath
 17 The Poisson Distribution
The Poisson Distribution
ritvikmath
 18 The Bernoulli Distribution
The Bernoulli Distribution
ritvikmath
 19 The Binomial Distribution
The Binomial Distribution
ritvikmath
 20 The Continuous Uniform Distribution
The Continuous Uniform Distribution
ritvikmath
 21 The Geometric Distribution
The Geometric Distribution
ritvikmath
 22 The Triangular Distribution
The Triangular Distribution
ritvikmath
 23 The Exponential Distribution
The Exponential Distribution
ritvikmath
 24 The Borel Distribution + Notes on Poisson Distribution
The Borel Distribution + Notes on Poisson Distribution
ritvikmath
 25 The Gamma Distribution
The Gamma Distribution
ritvikmath
 26 The Normal Distribution
The Normal Distribution
ritvikmath
 27 The Laplace Distribution
The Laplace Distribution
ritvikmath
 28 The Chi - Squared Distribution
The Chi - Squared Distribution
ritvikmath
 29 Overfitting
Overfitting
ritvikmath
 30 Vector Norms
Vector Norms
ritvikmath
 31 Truths Behind the Titanic : K-Nearest Neighbor
Truths Behind the Titanic : K-Nearest Neighbor
ritvikmath
 32 The Mathematics of Breakups
The Mathematics of Breakups
ritvikmath
 33 Sillyfish
Sillyfish
ritvikmath
 34 Finding Optimal Paths - Dynamic Programming
Finding Optimal Paths - Dynamic Programming
ritvikmath
 35 HowToDataScience : Scraping Twitter Data
HowToDataScience : Scraping Twitter Data
ritvikmath
 36 Decision Trees
Decision Trees
ritvikmath
 37 Perceptron
Perceptron
ritvikmath
 38 Naive Bayes
Naive Bayes
ritvikmath
 39 K-Nearest Neighbor
K-Nearest Neighbor
ritvikmath
 40 Evaluating Machine Learning Models
Evaluating Machine Learning Models
ritvikmath
 41 Decision Tree Pruning
Decision Tree Pruning
ritvikmath
 42 K-Means Clustering
K-Means Clustering
ritvikmath
 43 Gaussian Mixture Model
Gaussian Mixture Model
ritvikmath
 44 Data Science - Fuzzy Record Matching
Data Science - Fuzzy Record Matching
ritvikmath
 45 Time Series Talk : Autocorrelation and Partial Autocorrelation
Time Series Talk : Autocorrelation and Partial Autocorrelation
ritvikmath
 46 Time Series Talk : Autoregressive Model
Time Series Talk : Autoregressive Model
ritvikmath
 47 Time Series Talk : Moving Average Model
Time Series Talk : Moving Average Model
ritvikmath
 48 Time Series Talk : ARMA Model
Time Series Talk : ARMA Model
ritvikmath
 49 Time Series Talk : ARCH Model
Time Series Talk : ARCH Model
ritvikmath
 50 Time Series Talk : White Noise
Time Series Talk : White Noise
ritvikmath
 51 Time Series Talk : Stationarity
Time Series Talk : Stationarity
ritvikmath
 52 Time Series Talk : ARIMA Model
Time Series Talk : ARIMA Model
ritvikmath
 53 Time Series Talk : Lag Operator
Time Series Talk : Lag Operator
ritvikmath
 54 Time Series Talk : What is Seasonality ?
Time Series Talk : What is Seasonality ?
ritvikmath
 55 Time Series Talk : Seasonal ARIMA Model
Time Series Talk : Seasonal ARIMA Model
ritvikmath
 56 So ... What Actually is a Matrix ? : Data Science Basics
So ... What Actually is a Matrix ? : Data Science Basics
ritvikmath
 57 Derivative of a Matrix : Data Science Basics
Derivative of a Matrix : Data Science Basics
ritvikmath
 58 Basics of PCA (Principal Component Analysis) : Data Science Concepts
Basics of PCA (Principal Component Analysis) : Data Science Concepts
ritvikmath
 59 Eigenvalues & Eigenvectors : Data Science Basics
Eigenvalues & Eigenvectors : Data Science Basics
ritvikmath
 60 The Covariance Matrix : Data Science Basics
The Covariance Matrix : Data Science Basics
ritvikmath

Related AI Lessons

Chapters (12)

Problem with Simple RNNs
11:45 Goal of LSTM
12:55 Introducing the Cell State
14:27 Step 1: The Candidate Cell State
15:52 Step 2: The Forget Gate
17:48 Step 3: The Input Gate
18:18 Step 4: The New Cell State
21:15 Step 5: The Output Gate
22:31 Step 6: The New Output State
22:57 Visual Diagram
27:14 Recap all Variables
29:49 Why does this work?
Up next
Foundations of Data Structures and Algorithms in JavaScript
Coursera
Watch →