Foundations

ML Fundamentals

Neural networks, backpropagation, gradient descent — the maths behind AI

12,264
lessons
Skills in this topic
View full skill map →
ML Maths Basics
beginner
Manipulate vectors and matrices
Supervised Learning
beginner
Train decision trees, random forests, and neural nets
Unsupervised Learning
intermediate
Apply k-means and DBSCAN clustering
ML Pipelines
intermediate
Engineer features and handle missing data
Videos 10,799 Reads 1,465
Level: All Beginner Intermediate Advanced
Any Length Short (<5m) Medium (5-20m) Long (>20m)
Newest Popular Oldest
What is end-to-end deep learning? (C3W2L09)
ML Fundamentals ⚡ AI Lesson
What is end-to-end deep learning? (C3W2L09)
DeepLearningAI Beginner 8y ago
Multitask Learning (C3W2L08)
ML Fundamentals ⚡ AI Lesson
Multitask Learning (C3W2L08)
DeepLearningAI Beginner 8y ago
Addressing Data Mismatch (C3W2L06)
ML Fundamentals
Addressing Data Mismatch (C3W2L06)
DeepLearningAI Beginner 8y ago
Transfer Learning (C3W2L07)
ML Fundamentals ⚡ AI Lesson
Transfer Learning (C3W2L07)
DeepLearningAI Beginner 8y ago
Bias and Variance With Mismatched Data (C3W2L05)
ML Fundamentals ⚡ AI Lesson
Bias and Variance With Mismatched Data (C3W2L05)
DeepLearningAI Beginner 8y ago
Regularization (C2W1L04)
ML Fundamentals
Regularization (C2W1L04)
DeepLearningAI Beginner 8y ago
Why Regularization Reduces Overfitting (C2W1L05)
ML Fundamentals
Why Regularization Reduces Overfitting (C2W1L05)
DeepLearningAI Beginner 8y ago
Basic Recipe for Machine Learning (C2W1L03)
ML Fundamentals
Basic Recipe for Machine Learning (C2W1L03)
DeepLearningAI Beginner 8y ago
Bias/Variance (C2W1L02)
ML Fundamentals
Bias/Variance (C2W1L02)
DeepLearningAI Beginner 8y ago
Forward Propagation in a Deep Network (C1W4L02)
ML Fundamentals
Forward Propagation in a Deep Network (C1W4L02)
DeepLearningAI Beginner 8y ago
Weight Initialization in a Deep Network (C2W1L11)
ML Fundamentals
Weight Initialization in a Deep Network (C2W1L11)
DeepLearningAI Beginner 8y ago
Numerical Approximations of Gradients (C2W1L12)
ML Fundamentals
Numerical Approximations of Gradients (C2W1L12)
DeepLearningAI Beginner 8y ago
What does this have to do with the brain? (C1W4L08)
ML Fundamentals
What does this have to do with the brain? (C1W4L08)
DeepLearningAI Beginner 8y ago
Dropout Regularization (C2W1L06)
ML Fundamentals ⚡ AI Lesson
Dropout Regularization (C2W1L06)
DeepLearningAI Beginner 8y ago
Vanishing/Exploding Gradients (C2W1L10)
ML Fundamentals ⚡ AI Lesson
Vanishing/Exploding Gradients (C2W1L10)
DeepLearningAI Beginner 8y ago
Train/Dev/Test Sets (C2W1L01)
ML Fundamentals ⚡ AI Lesson
Train/Dev/Test Sets (C2W1L01)
DeepLearningAI Beginner 8y ago
Deep L-Layer Neural Network (C1W4L01)
ML Fundamentals ⚡ AI Lesson
Deep L-Layer Neural Network (C1W4L01)
DeepLearningAI Beginner 8y ago
Random Initialization (C1W3L11)
ML Fundamentals
Random Initialization (C1W3L11)
DeepLearningAI Beginner 8y ago
Other Regularization Methods (C2W1L08)
ML Fundamentals ⚡ AI Lesson
Other Regularization Methods (C2W1L08)
DeepLearningAI Beginner 8y ago
Normalizing Inputs (C2W1L09)
ML Fundamentals
Normalizing Inputs (C2W1L09)
DeepLearningAI Beginner 8y ago
Derivatives Of Activation Functions (C1W3L08)
ML Fundamentals ⚡ AI Lesson
Derivatives Of Activation Functions (C1W3L08)
DeepLearningAI Beginner 8y ago
Parameters vs Hyperparameters (C1W4L07)
ML Fundamentals
Parameters vs Hyperparameters (C1W4L07)
DeepLearningAI Beginner 8y ago
Vectorizing Across Multiple Examples (C1W3L04)
ML Fundamentals ⚡ AI Lesson
Vectorizing Across Multiple Examples (C1W3L04)
DeepLearningAI Beginner 8y ago
Understanding Dropout (C2W1L07)
ML Fundamentals ⚡ AI Lesson
Understanding Dropout (C2W1L07)
DeepLearningAI Beginner 8y ago
Building Blocks of a Deep Neural Network (C1W4L05)
ML Fundamentals ⚡ AI Lesson
Building Blocks of a Deep Neural Network (C1W4L05)
DeepLearningAI Beginner 8y ago
Why Non-linear Activation Functions (C1W3L07)
ML Fundamentals ⚡ AI Lesson
Why Non-linear Activation Functions (C1W3L07)
DeepLearningAI Beginner 8y ago
Computing Neural Network Output (C1W3L03)
ML Fundamentals ⚡ AI Lesson
Computing Neural Network Output (C1W3L03)
DeepLearningAI Beginner 8y ago
Backpropagation Intuition (C1W3L10)
ML Fundamentals
Backpropagation Intuition (C1W3L10)
DeepLearningAI Beginner 8y ago
Why Deep Representations? (C1W4L04)
ML Fundamentals ⚡ AI Lesson
Why Deep Representations? (C1W4L04)
DeepLearningAI Beginner 8y ago
Gradient Descent For Neural Networks (C1W3L09)
ML Fundamentals ⚡ AI Lesson
Gradient Descent For Neural Networks (C1W3L09)
DeepLearningAI Beginner 8y ago
Neural Network Representations (C1W3L02)
ML Fundamentals
Neural Network Representations (C1W3L02)
DeepLearningAI Beginner 8y ago
TensorFlow (C2W3L11)
ML Fundamentals ⚡ AI Lesson
TensorFlow (C2W3L11)
DeepLearningAI Beginner 8y ago
Activation Functions (C1W3L06)
ML Fundamentals
Activation Functions (C1W3L06)
DeepLearningAI Beginner 8y ago
Explanation For Vectorized Implementation (C1W3L05)
ML Fundamentals
Explanation For Vectorized Implementation (C1W3L05)
DeepLearningAI Beginner 8y ago
Getting Matrix Dimensions Right (C1W4L03)
ML Fundamentals
Getting Matrix Dimensions Right (C1W4L03)
DeepLearningAI Beginner 8y ago
Deep Learning Frameworks (C2W3L10)
ML Fundamentals ⚡ AI Lesson
Deep Learning Frameworks (C2W3L10)
DeepLearningAI Beginner 8y ago
Neural Network Overview (C1W3L01)
ML Fundamentals ⚡ AI Lesson
Neural Network Overview (C1W3L01)
DeepLearningAI Beginner 8y ago
Training Softmax Classifier (C2W3L09)
ML Fundamentals
Training Softmax Classifier (C2W3L09)
DeepLearningAI Beginner 8y ago
Softmax Regression (C2W3L08)
ML Fundamentals ⚡ AI Lesson
Softmax Regression (C2W3L08)
DeepLearningAI Beginner 8y ago
Batch Norm At Test Time (C2W3L07)
ML Fundamentals ⚡ AI Lesson
Batch Norm At Test Time (C2W3L07)
DeepLearningAI Beginner 8y ago
Why Does Batch Norm Work? (C2W3L06)
ML Fundamentals
Why Does Batch Norm Work? (C2W3L06)
DeepLearningAI Beginner 8y ago
Adam Optimization Algorithm (C2W2L08)
ML Fundamentals ⚡ AI Lesson
Adam Optimization Algorithm (C2W2L08)
DeepLearningAI Beginner 8y ago
RMSProp (C2W2L07)
ML Fundamentals
RMSProp (C2W2L07)
DeepLearningAI Beginner 8y ago
Fitting Batch Norm Into Neural Networks (C2W3L05)
ML Fundamentals
Fitting Batch Norm Into Neural Networks (C2W3L05)
DeepLearningAI Beginner 8y ago
Gradient Descent With Momentum (C2W2L06)
ML Fundamentals ⚡ AI Lesson
Gradient Descent With Momentum (C2W2L06)
DeepLearningAI Beginner 8y ago
Normalizing Activations in a Network (C2W3L04)
ML Fundamentals
Normalizing Activations in a Network (C2W3L04)
DeepLearningAI Beginner 8y ago
Hyperparameter Tuning in Practice (C2W3L03)
ML Fundamentals
Hyperparameter Tuning in Practice (C2W3L03)
DeepLearningAI Beginner 8y ago
Tuning Process (C2W3L01)
ML Fundamentals ⚡ AI Lesson
Tuning Process (C2W3L01)
DeepLearningAI Beginner 8y ago
📚 Coursera Courses Opens on Coursera · Free to audit
1 / 3 View all →
Python: Mastering NumPy Essentials
📚 Coursera Course ↗
Self-paced
Python: Mastering NumPy Essentials
Opens on Coursera ↗
Predictive Analytics Model for Term Deposit Investment
📚 Coursera Course ↗
Self-paced
Predictive Analytics Model for Term Deposit Investment
Opens on Coursera ↗
Aerial Image Segmentation with PyTorch
📚 Coursera Course ↗
Self-paced
Aerial Image Segmentation with PyTorch
Opens on Coursera ↗
Machine Learning Operations (MLOps): Getting Started - Português Brasileiro
📚 Coursera Course ↗
Self-paced
Machine Learning Operations (MLOps): Getting Started - Português Brasileiro
Opens on Coursera ↗
Machine Learning in Retail
📚 Coursera Course ↗
Self-paced
Machine Learning in Retail
Opens on Coursera ↗
Probabilistic Graphical Models 1: Representation
📚 Coursera Course ↗
Self-paced
Probabilistic Graphical Models 1: Representation
Opens on Coursera ↗