Foundations

ML Fundamentals

Neural networks, backpropagation, gradient descent — the maths behind AI

8592
lessons
Level: All Beginner Intermediate Advanced
Any Length Short (<5m) Medium (5-20m) Long (>20m)
Newest Popular Oldest
Basic Recipe for Machine Learning (C2W1L03)
ML Fundamentals
Basic Recipe for Machine Learning (C2W1L03)
DeepLearningAI Beginner 8y ago
Bias/Variance (C2W1L02)
ML Fundamentals
Bias/Variance (C2W1L02)
DeepLearningAI Beginner 8y ago
Forward Propagation in a Deep Network (C1W4L02)
ML Fundamentals
Forward Propagation in a Deep Network (C1W4L02)
DeepLearningAI Beginner 8y ago
Weight Initialization in a Deep Network (C2W1L11)
ML Fundamentals
Weight Initialization in a Deep Network (C2W1L11)
DeepLearningAI Beginner 8y ago
Numerical Approximations of Gradients (C2W1L12)
ML Fundamentals
Numerical Approximations of Gradients (C2W1L12)
DeepLearningAI Beginner 8y ago
What does this have to do with the brain? (C1W4L08)
ML Fundamentals
What does this have to do with the brain? (C1W4L08)
DeepLearningAI Beginner 8y ago
Dropout Regularization (C2W1L06)
ML Fundamentals
Dropout Regularization (C2W1L06)
DeepLearningAI Beginner 8y ago
Vanishing/Exploding Gradients (C2W1L10)
ML Fundamentals
Vanishing/Exploding Gradients (C2W1L10)
DeepLearningAI Beginner 8y ago
Train/Dev/Test Sets (C2W1L01)
ML Fundamentals
Train/Dev/Test Sets (C2W1L01)
DeepLearningAI Beginner 8y ago
Deep L-Layer Neural Network (C1W4L01)
ML Fundamentals
Deep L-Layer Neural Network (C1W4L01)
DeepLearningAI Beginner 8y ago
Random Initialization (C1W3L11)
ML Fundamentals
Random Initialization (C1W3L11)
DeepLearningAI Beginner 8y ago
Other Regularization Methods (C2W1L08)
ML Fundamentals
Other Regularization Methods (C2W1L08)
DeepLearningAI Beginner 8y ago
Normalizing Inputs (C2W1L09)
ML Fundamentals
Normalizing Inputs (C2W1L09)
DeepLearningAI Beginner 8y ago
Derivatives Of Activation Functions (C1W3L08)
ML Fundamentals
Derivatives Of Activation Functions (C1W3L08)
DeepLearningAI Beginner 8y ago
Parameters vs Hyperparameters (C1W4L07)
ML Fundamentals
Parameters vs Hyperparameters (C1W4L07)
DeepLearningAI Beginner 8y ago
Vectorizing Across Multiple Examples (C1W3L04)
ML Fundamentals
Vectorizing Across Multiple Examples (C1W3L04)
DeepLearningAI Beginner 8y ago
Understanding Dropout (C2W1L07)
ML Fundamentals
Understanding Dropout (C2W1L07)
DeepLearningAI Beginner 8y ago
Building Blocks of a Deep Neural Network (C1W4L05)
ML Fundamentals
Building Blocks of a Deep Neural Network (C1W4L05)
DeepLearningAI Beginner 8y ago
Why Non-linear Activation Functions (C1W3L07)
ML Fundamentals
Why Non-linear Activation Functions (C1W3L07)
DeepLearningAI Beginner 8y ago
Computing Neural Network Output (C1W3L03)
ML Fundamentals
Computing Neural Network Output (C1W3L03)
DeepLearningAI Beginner 8y ago
Backpropagation Intuition (C1W3L10)
ML Fundamentals
Backpropagation Intuition (C1W3L10)
DeepLearningAI Beginner 8y ago
Why Deep Representations? (C1W4L04)
ML Fundamentals
Why Deep Representations? (C1W4L04)
DeepLearningAI Beginner 8y ago
Gradient Descent For Neural Networks (C1W3L09)
ML Fundamentals
Gradient Descent For Neural Networks (C1W3L09)
DeepLearningAI Beginner 8y ago
Neural Network Representations (C1W3L02)
ML Fundamentals
Neural Network Representations (C1W3L02)
DeepLearningAI Beginner 8y ago
TensorFlow (C2W3L11)
ML Fundamentals
TensorFlow (C2W3L11)
DeepLearningAI Beginner 8y ago
Activation Functions (C1W3L06)
ML Fundamentals
Activation Functions (C1W3L06)
DeepLearningAI Beginner 8y ago
Explanation For Vectorized Implementation (C1W3L05)
ML Fundamentals
Explanation For Vectorized Implementation (C1W3L05)
DeepLearningAI Beginner 8y ago
Getting Matrix Dimensions Right (C1W4L03)
ML Fundamentals
Getting Matrix Dimensions Right (C1W4L03)
DeepLearningAI Beginner 8y ago
Deep Learning Frameworks (C2W3L10)
ML Fundamentals
Deep Learning Frameworks (C2W3L10)
DeepLearningAI Beginner 8y ago
Neural Network Overview (C1W3L01)
ML Fundamentals
Neural Network Overview (C1W3L01)
DeepLearningAI Beginner 8y ago
Training Softmax Classifier (C2W3L09)
ML Fundamentals
Training Softmax Classifier (C2W3L09)
DeepLearningAI Beginner 8y ago
Softmax Regression (C2W3L08)
ML Fundamentals
Softmax Regression (C2W3L08)
DeepLearningAI Beginner 8y ago
Batch Norm At Test Time (C2W3L07)
ML Fundamentals
Batch Norm At Test Time (C2W3L07)
DeepLearningAI Beginner 8y ago
Why Does Batch Norm Work? (C2W3L06)
ML Fundamentals
Why Does Batch Norm Work? (C2W3L06)
DeepLearningAI Beginner 8y ago
Adam Optimization Algorithm (C2W2L08)
ML Fundamentals
Adam Optimization Algorithm (C2W2L08)
DeepLearningAI Beginner 8y ago
RMSProp (C2W2L07)
ML Fundamentals
RMSProp (C2W2L07)
DeepLearningAI Beginner 8y ago
Fitting Batch Norm Into Neural Networks (C2W3L05)
ML Fundamentals
Fitting Batch Norm Into Neural Networks (C2W3L05)
DeepLearningAI Beginner 8y ago
Gradient Descent With Momentum (C2W2L06)
ML Fundamentals
Gradient Descent With Momentum (C2W2L06)
DeepLearningAI Beginner 8y ago
Normalizing Activations in a Network (C2W3L04)
ML Fundamentals
Normalizing Activations in a Network (C2W3L04)
DeepLearningAI Beginner 8y ago
Hyperparameter Tuning in Practice (C2W3L03)
ML Fundamentals
Hyperparameter Tuning in Practice (C2W3L03)
DeepLearningAI Beginner 8y ago
Tuning Process (C2W3L01)
ML Fundamentals
Tuning Process (C2W3L01)
DeepLearningAI Beginner 8y ago
Understanding Exponentially Weighted Averages (C2W2L04)
ML Fundamentals
Understanding Exponentially Weighted Averages (C2W2L04)
DeepLearningAI Beginner 8y ago
Bias Correction of Exponentially Weighted Averages (C2W2L05)
ML Fundamentals
Bias Correction of Exponentially Weighted Averages (C2W2L05)
DeepLearningAI Beginner 8y ago
Understanding Mini-Batch Gradient Dexcent (C2W2L02)
ML Fundamentals
Understanding Mini-Batch Gradient Dexcent (C2W2L02)
DeepLearningAI Beginner 8y ago
Mini Batch Gradient Descent (C2W2L01)
ML Fundamentals
Mini Batch Gradient Descent (C2W2L01)
DeepLearningAI Beginner 8y ago
The Problem of Local Optima (C2W3L10)
ML Fundamentals
The Problem of Local Optima (C2W3L10)
DeepLearningAI Beginner 8y ago
Exponentially Weighted Averages (C2W2L03)
ML Fundamentals
Exponentially Weighted Averages (C2W2L03)
DeepLearningAI Beginner 8y ago
Gradient Checking Implementation Notes (C2W1L14)
ML Fundamentals
Gradient Checking Implementation Notes (C2W1L14)
DeepLearningAI Beginner 8y ago
📚 Coursera Courses Opens on Coursera · Free to audit
1 / 3 View all →
Matrix Calculus for Data Science & Machine Learning
📚 Coursera Course ↗
Self-paced
Matrix Calculus for Data Science & Machine Learning
Opens on Coursera ↗
Classify Images of Cats and Dogs using Transfer Learning
📚 Coursera Course ↗
Self-paced
Classify Images of Cats and Dogs using Transfer Learning
Opens on Coursera ↗
Deep Learning: Build & Optimize Neural Networks
📚 Coursera Course ↗
Self-paced
Deep Learning: Build & Optimize Neural Networks
Opens on Coursera ↗
Production Machine Learning Systems - Português Brasileiro
📚 Coursera Course ↗
Self-paced
Production Machine Learning Systems - Português Brasileiro
Opens on Coursera ↗
Machine Learning in Production
📚 Coursera Course ↗
Self-paced
Machine Learning in Production
Opens on Coursera ↗
Machine Learning Operations (MLOps): Getting Started - Français
📚 Coursera Course ↗
Self-paced
Machine Learning Operations (MLOps): Getting Started - Français
Opens on Coursera ↗